Cloud Data Engineer - BLR
PhotonBengaluru, Karnataka, India
Posted February 18, 2025
Full Time
About the Company
Photon is a global leader in AI and digital solutions, accelerating AI adoption and enabling Fortune 100 clients to stay agile and future-ready. With expertise in IoT, API management, big data analytics, and more, Photon combines AI management, digital innovation, and engineering excellence to drive lasting transformation for F500 clients across billions of touchpoints daily. Employing thousands worldwide, Photon's comprehensive suite of services positions them as a distinctive player in the converging digital and AI landscape.
Job Description
We are seeking a Data Engineer with expertise in Python, PySpark, AWS Glue, and Lambda to develop and optimize data processing pipelines. The role involves working with large-scale data, designing workflows, and integrating with cloud-based services. Experience with PL/SQL, PostgreSQL, and Java API is a plus.
Requirements
- Develop and optimize ETL pipelines using AWS Glue, Lambda, and PySpark.
- Work with large-scale data processing and transformation using Python and Spark.
- Design and implement data workflows for structured and unstructured data.
- Optimize queries and data storage for performance and cost efficiency.
- Develop and maintain data models, schemas, and database structures using PL/SQL and PostgreSQL.
- Integrate AWS services such as SNS and Step Functions, along with Java API development.