Data Engineer (Azure + Databricks)

We are looking for a highly experienced Data Engineer to design and build scalable data platforms using Azure and Databricks. The role involves leading end-to-end data engineering initiatives, building high-performance data pipelines, and enabling advanced analytics through modern Lakehouse architecture.

Requirements

• Design and implement scalable data pipelines using PySpark and Databricks
• Build and manage Lakehouse architecture using Delta Lake
• Lead data platform design, including data modelling, ingestion, transformation, and serving layers
• Optimize large-scale data processing jobs for performance and cost efficiency
• Implement data governance, security, and access control (e.g., Unity Catalog)
• Migrate legacy ETL/PLSQL workloads to modern cloud-based architectures
• Develop orchestration workflows using Databricks Workflows / Control-M / ADF
• Collaborate with business, analytics, and engineering teams to deliver data solutions
• Lead code reviews, enforce best practices, and mentor junior engineers
• Ensure CI/CD implementation and DevOps integration for data pipelines