Lead Data Engineer (Databricks)

We're seeking a Lead Data Engineer to drive the success of our data engineering initiatives, fostering trust and accountability within the team, and leveraging technical expertise to optimize data processes and deliver exceptional data solutions.

Requirements

• 10+ years of experience in data engineering, data architecture, or related fields
• Extensive experience in writing and testing Java and/or Python
• Proven experience with data pipeline orchestration using platforms such as Airflow, Databricks, DBT or AWS Glue
• Hands-on experience with data analysis tools and libraries like Pyspark, NumPy, Pandas, or Dask
• Proficiency with Spark and Databricks is highly desirable
• Proven track record of leading complex data engineering projects
• Strong understanding of cloud-based data services and technologies
• Exceptional communication and interpersonal skills