Senior Azure Data Engineer (Databricks) role at Capco, responsible for designing, building, and deploying scalable and secure data engineering pipelines using Databricks platform on Azure.
Requirements
- Design and develop robust pipelines using DeltaLake, Spark Structured Streaming, and Unity Catalog
- Build real-time event-driven solutions with tools such as Kafka and Azure Event Hubs
- Apply DevOps principles to develop CI/CD pipelines using Azure DevOps, Jenkins, or GitHub Actions
- Collaborate with clients and stakeholders to translate data needs into strategic technical solutions
- Champion clean code, data lifecycle optimisation, and software engineering best practices
Benefits
- Discretionary bonus
- Competitive pension
- Health insurance
- Life insurance and critical illness cover
- Mental health support
- Family-friendly benefits
- Family care support
- Holiday flexibility
- Continuous learning opportunities
- Healthcare access
- Extra perks