We are looking to expand the in-house expertise in Data Technology and need talented and skilled colleagues to implement data engineering solutions using latest technologies available in Azure Cloud space.
Requirements
- 4-7 years of experience in Azure Data Engineering
- Graduate/Post-graduate degree in Computer Science, Statistics, Mathematics, Data Science, Engineering or related discipline
- Microsoft Azure certification (good to have)
- Experience in migrating on-premise data warehouses to data platforms on AZURE cloud
- Designing and implementing data engineering, ingestion and transformation functions using ADF, Databricks
- Proficient in Py-Spark
- Experience in building Python based APIs on Azure Function Apps
- Experience on Azure Logic apps
- Experience in Lakehouse/Datawarehouse implementation using modern data platform architecture
- Capacity Planning and Performance Tuning on ADF & Databricks pipelines
- Support data visualization development using Power BI
- Exposure across all the SDLC process, including testing and deployment
- Experience in relational and dimensional modelling, including big data technologies
- Experience in Azure DevOps ā Build CI/CD pipelines for ADF, ADLS, Databricks, Azure SQL DB etc
- Experience of working in secured Azure environments using Azure KeyVaults, Service Principals, and Managed Identities
- Understanding of data masking, encryption and other practices used in handling sensitive data
- Ability to interact with Business for requirement gathering and query resolutions