Lead Data Engineer H/F

Lead Data Engineer to oversee the development and optimization of data infrastructure for the launch of a new product, working closely with cross-functional teams to use data to improve internal processes and product features.

Requirements

• Design, build, and maintain a data infrastructure to meet business needs
• Define and implement best practices for data architecture, storage, and processing pipelines
• Optimize data ingestion, transformation, and activation to ensure efficiency and scalability
• Drive data warehouse and data lake strategy
• Lead the development of ETL workflows using tools like Airflow, dbt, Apache Spark, or KaWa
• Implement and manage batch and real-time data processing pipelines
• Improve data reliability, quality, and accessibility through robust monitoring and logging
• Develop and enforce data governance policies
• Use cloud services for evolving data processing and storage
• Optimize infrastructure costs while maintaining high availability and performance
• Research and implement emerging technologies to improve data processing and analysis capabilities
• Define team objectives, roadmaps, and delivery deadlines in collaboration with stakeholders
• Promote continuous workflow improvement, automation, and documentation