We are seeking a highly skilled Senior Data Engineer with strong expertise in Databricks, PySpark, and Data Modeling to lead the design and development of scalable data solutions on Azure.
Requirements
- Design, develop, and deploy robust data engineering solutions using Azure Databricks, PySpark, SQL, and Azure Data Factory (ADF).
- Build and maintain scalable and efficient data pipelines to support growing data volume and complexity.
- Lead data modeling efforts including conceptual, logical, and physical models for structured and semi-structured data.
- Develop Modern Data Warehouse solutions leveraging Azure Data Lake, Delta Lake, and Databricks.
- Implement batch and streaming data processing solutions for structured and unstructured data sources.
- Create and maintain technical design documents, including application interface designs and data flow diagrams.
- Collaborate with BI, analytics, and business teams to understand data requirements and deliver high-quality solutions.
- Optimize data workflows and ensure data quality, consistency, and governance across platforms.