Senior Associate Data Engineer

Design and implement end-to-end data ingestion pipelines, build and manage lakehouse and data warehouse solutions, develop and optimize data transformations, and partner with cross-functional teams to support data modeling, analytics, and downstream consumption use cases.

Requirements

• Hands-on experience or strong working knowledge of Microsoft Fabric, including its role in modern analytics and lakehouse architectures.
• Proven experience working in Azure for data ingestion and orchestration.
• Strong experience with Azure Data Factory (ADF) for pipeline development and scheduling.
• Experience building API-based data ingestion solutions.
• Solid understanding of data storage formats, including CSV, JSON, and Parquet.
• Experience designing and working with data warehouses and lakehouse architectures.
• Strong foundation in data modeling concepts for analytical workloads.
• Practical experience implementing medallion architecture patterns.
• Proficiency in PySpark for large-scale data transformations and optimization.
• Ability to write clean, maintainable, and well-documented data pipelines.