Manager-Data Engineering-Cloud Data Engineering

Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.

Requirements

• Strong knowledge on Python and Pyspark
• Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum
• Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks
• Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing
• Strong problem-solving and troubleshooting skills
• Establish comprehensive data quality test cases, procedures and implement automated data validation processes
• 5-7 years of experience in Data Engineer