We are looking for a Senior Data Engineer to join our team at DigiOutsource. As a Senior Data Engineer, you will be a key driver in our transition from an on-premises data infrastructure to a modern, scalable cloud lake house architecture. You will design, develop, and optimize robust data pipelines for on-premises and hybrid cloud environments, and lead efforts to migrate data and systems from on-premises databases to a cloud lake house architecture.
Requirements
- Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field (Master’s preferred).
- 5+ years of experience in data engineering or related roles.
- Relevant certifications (e.g., AWS Certified Data Analytics Specialty, Microsoft Certified: Azure Data Engineer, or Databricks Certified Data Engineer).
- Strong expertise in SQL, including querying, optimization, and writing stored procedures.
- Proven experience in cloud-based data platforms such as AWS Redshift, Azure Synapse, or Google BigQuery.
- Knowledge of cloud lake house technologies (e.g., Delta Lake, Apache Iceberg, or Apache Hudi).
- Hands-on experience with streaming platforms such as Kafka or RabbitMQ.
- Expertise in data modelling for both on-premises and cloud-based systems.
- Proficiency in Python, Java, or Scala for data engineering tasks.
- Experience with CI/CD practices for data pipelines in a cloud environment.
- Familiarity with data governance and security best practices in cloud environments.
- Strong leadership and mentoring skills, with experience guiding junior team members.
Benefits
- Comprehensive learning and development programmes
- Regular, constructive feedback
- Employee Assistance programme
- Free Daily Meal
- Free Massages On-site
- Free On-Site Gym
- Group Life Cover
- Funeral Fund Benefit
- Financial Services Assistance
- Curro School Fees Benefit
- Income Continuation Benefit
- Leadership Training
- Referral Bonus
- Medical Aid Subsidy
- Free Sleep Coaching
- On-site Barista
- Retirement Annuity Subsidy
- Team socials