Data Engineer (Azure/ Databricks)

Keyrus believes in diversity and inclusion and is looking for a talented Data Engineer to develop and maintain processes that provide data for analysis, create end-to-end pipelines, and ensure efficiency, governance, scalability, and alignment with business demands.

Requirements

• Experience with Azure (Data Lake, Functions, Data Factory, Synapse, or equivalent services)
• Experience with Databricks and development of distributed pipelines
• Solid knowledge in PySpark
• Experience with Airflow and pipeline orchestration
• Knowledge in DevOps (CI/CD, versioning, deployment automation)
• Building and maintaining data jobs and processes in production
• Knowledge in data modeling (dimensional, relational, data vault, etc)
• Experience with reusable components and internal libraries (desirable)
• Familiarity with MLOps environments (desirable)
• Experience with data governance (cataloging, lineage, policies) (desirable)