Sr Data Engineer - Spark-Scala - Chennai
PhotonChennai, Tamil Nadu, India
Posted January 22, 2026
Full Time
About the Company
Photon is a global leader in AI and digital solutions, accelerating AI adoption and enabling Fortune 100 clients to stay agile and future-ready. With expertise in IoT, API management, big data analytics, and more, Photon combines AI management, digital innovation, and engineering excellence to drive lasting transformation for F500 clients across billions of touchpoints daily. Employing thousands worldwide, Photon's comprehensive suite of services positions them as a distinctive player in the converging digital and AI landscape.
Job Description
Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets.
Requirements
- Minimum 8 years of experience in application development
- Strong hands on experience in Apache Spark, Scala, and Spark SQL for distributed data processing
- Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop
- Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi
- Experience building and optimizing ETL pipelines using Spark and working with structured and unstructured data
- Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL
- Knowledge of data warehousing concepts, dimensional modeling, and data lakes
- Ability to troubleshoot and optimize Spark and Cloudera platform performance
- Familiarity with version control tools like Git and CI/CD tools (e.g., Jenkins, GitLab)
Benefits
- Medical, vision, and dental benefits
- 401k retirement plan
- Variable pay/incentives
- Paid time off
- Paid holidays