Data Engineer - Chennai / Bengaluru
PhotonChennai, Tamil Nadu, India • Bengaluru, Karnataka, India
Posted February 5, 2025
Full Time
About the Company
Photon is a global leader in AI and digital solutions, accelerating AI adoption and enabling Fortune 100 clients to stay agile and future-ready. With expertise in IoT, API management, big data analytics, and more, Photon combines AI management, digital innovation, and engineering excellence to drive lasting transformation for F500 clients across billions of touchpoints daily. Employing thousands worldwide, Photon's comprehensive suite of services positions them as a distinctive player in the converging digital and AI landscape.
Job Description
The Data Engineer will develop and maintain data pipelines, ETL processes, and workflow orchestration using Apache Airflow, Python, and PySpark. This role focuses on efficient and reliable data delivery from various data sources. Collaboration with cross-functional teams and implementation of dataOps principles are crucial aspects of the position.
Requirements
- Develop and maintain data pipelines, ELT processes, and workflow orchestration.
- Design and implement custom connectors for data ingestion.
- Implement DataOps principles and best practices.
- Monitor and troubleshoot data pipelines.
Benefits
- Competitive salary
- Opportunity for growth
- Collaboration with experienced professionals