We are seeking a Data Engineer to join our team at the Clean Energy Regulator. The role involves designing, constructing, and optimizing data lakes, CI/CD, and Synapse pipelines within the Azure stack.
Requirements
- Bachelor's degree in computer science, Engineering, or a related field
- Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate
- 3+ years of experience in data engineering with a focus on Azure services
- Proven experience with Azure Data Lake, Azure Synapse Analytics, and CI/CD pipelines
- Demonstrated ability to design and implement scalable data architectures
- Experience in data migration and managing large-scale data pipelines
- Familiarity with DevOps practices and tools within the Azure ecosystem
- Strong technical skills in SQL, Python, and R
- Proficiency in data modelling including reuse and scalability patterns
- Knowledge of Azure Monitor, Azure Security, and compliance frameworks
- Ability to work with cross-functional teams and lead technical projects
- Experience building data profiling, data cleansing and data engineering frameworks