Unionsys Technologies is looking for a highly skilled Azure Data Engineer with 6-8 years of experience to join our dynamic team. The ideal candidate will have hands-on expertise in Azure-based data engineering solutions, including Azure Databricks, Azure Data Factory, Azure Data Lake, and PySpark.
Requirements
- Develop and implement data engineering solutions using Azure services such as Databricks, Data Factory, and Data Lake.
- Work extensively with PySpark to process and transform large datasets efficiently.
- Design, implement, and optimize Delta Lake architecture for scalable data storage and management.
- Manage Databricks Jobs, Scheduling, Orchestration, Workflow, and REST API integration.
- Collaborate with cross-functional teams to understand business requirements and translate them into data solutions.
- Ensure data integrity, quality, and security in cloud-based data platforms.
- Optimize data pipelines for performance and cost-efficiency.
- Troubleshoot and resolve data processing issues in the Azure ecosystem.
Benefits
- Competitive salary
- Growth opportunities in a fast-growing technology firm
- Collaborative and innovative work culture