Senior Data Engineer - Lakehouse & Data Engineering Frameworks - REF5085J

We are looking for a Senior Data Engineer to build and operate scalable data ingestion and CDC capabilities on our Azure-based Lakehouse platform. The successful candidate will help mature our engineering approach, design and develop ingestion pipelines, implement and operate CDC patterns, and structure and maintain bronze and silver Delta Lake datasets. The role also involves software engineering for data frameworks, operations, reliability & observability, and collaboration & leadership.

Requirements

• 3–5 years of hands-on experience building data pipelines with Databricks and Azure in production.
• Strong knowledge of Delta Lake patterns (CDC, schema evolution, deduplication, partitioning, performance optimization).
• Advanced Python engineering skills: building maintainable projects (packaging, dependency management, testing, tooling).
• Solid SQL skills (complex transformations, debugging, performance tuning).
• Proven experience with CI/CD and Git-based workflows (merge requests, branching strategies, automated testing, environment promotion).
• Ability to diagnose and resolve issues in distributed systems (Spark execution, cluster/runtime behavior, data correctness).
• Good understanding of data modeling principles and how they influence ingestion and performance.
• Practical experience applying data governance and security controls in a Lakehouse environment (permissions/access patterns, secure secret handling, audit needs; Unity Catalog is a plus).
• Proactive, reliable, and able to work independently within agile teams.
• Strong communication skills in English (spoken and written).

Benefits

• Competitive salary
• Benefits package
• Opportunities for growth and development