Scala/Spark Developer - Irving
PhotonColorado, United States
Posted March 11, 2025
44000 - 154000 USD year
Full Time
About the Company
Photon is a global leader in AI and digital solutions, accelerating AI adoption and enabling Fortune 100 clients to stay agile and future-ready. With expertise in IoT, API management, big data analytics, and more, Photon combines AI management, digital innovation, and engineering excellence to drive lasting transformation for F500 clients across billions of touchpoints daily. Employing thousands worldwide, Photon's comprehensive suite of services positions them as a distinctive player in the converging digital and AI landscape.
Job Description
This Scala/Spark Developer position is seeking a candidate with 6+ years of application development experience. The role involves designing, testing, and deploying data processing applications using Apache Spark and Scala, optimizing performance on large-scale data sets, and collaborating with cross-functional teams. They will also be responsible for maintaining data integrity and security.
Requirements
- Minimum 6 years of experience in application development
- Strong hands-on experience in Apache Spark, Scala, and Spark SQL for distributed data processing
- Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop
- Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi
- Experience building and optimizing ETL pipelines using Spark
- Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL
- Knowledge of data warehousing concepts, dimensional modeling, and data lakes
- Ability to troubleshoot and optimize Spark and Cloudera platform performance
- Familiarity with version control tools like Git and CI/CD tools (e.g., Jenkins, GitLab)
Benefits
- Medical, vision, and dental benefits
- 401k retirement plan
- Variable pay/incentives
- Paid time off
- Paid holidays