Associate - Data Engineer-Data Engineering-Big Data Engineering

We are looking for a skilled Data Engineer with experience in Databricks, Apache Spark, and distributed data processing to join our team. The ideal candidate will have 5-7 years of experience in data engineering and a strong understanding of data governance, cataloging, and security frameworks.

Requirements

• 5-7 years of experience in data engineering
• Strong expertise in Apache Spark (PySpark/Scala/SQL) and distributed data processing
• Solid experience with Delta Lake, Lakehouse architecture, and data modeling
• Hands-on experience with at least one cloud platform: Azure Data Lake, AWS S3, or GCP BigQuery/Storage
• Strong proficiency in SQL for data manipulation and performance tuning
• Experience with ETL frameworks, workflow orchestration tools (Airflow, ADF, DBX Workflows)
• Good understanding of CI/CD, Git-based workflows, and DevOps practices
• Exposure to MLOps and MLflow is a strong plus
• Knowledge of data governance, cataloging, and security frameworks