UnionSys Technologies-Azure Data Engineer

Unionsys Technologies is looking for a highly skilled Azure Data Engineer with 6-8 years of experience to join our dynamic team. The ideal candidate will have hands-on expertise in Azure-based data engineering solutions, including Azure Databricks, Azure Data Factory, Azure Data Lake, and PySpark.

Requirements

• Develop and implement data engineering solutions using Azure services such as Databricks, Data Factory, and Data Lake.
• Work extensively with PySpark to process and transform large datasets efficiently.
• Design, implement, and optimize Delta Lake architecture for scalable data storage and management.
• Manage Databricks Jobs, Scheduling, Orchestration, Workflow, and REST API integration.
• Collaborate with cross-functional teams to understand business requirements and translate them into data solutions.
• Ensure data integrity, quality, and security in cloud-based data platforms.
• Optimize data pipelines for performance and cost-efficiency.
• Troubleshoot and resolve data processing issues in the Azure ecosystem.

Benefits

• Competitive salary
• Growth opportunities in a fast-growing technology firm
• Collaborative and innovative work culture