The Spark Data Engineer, Senior position involves implementing data engineering activities on mission-driven projects, deploying and developing pipelines and platforms to organize and make disparate data meaningful, and working with a multi-disciplinary team to use big data for good.
Requirements
- 5+ years of experience in Spark development, including PySpark or Java Spark
- 5+ years of experience designing, developing, operationalizing, and maintaining complex data applications at enterprise scale
- 5+ years of experience with big data and building ETL pipelines to efficiently process petabyte scale data
- Experience with modeling complex data structures of varied formats
- Experience with distributed data and computing tools, including Spark, AWS, or Kafka
- Experience creating solutions within a collaborative, cross-functional team environment
- Ability to develop scripts and programs for converting various types of data into usable formats and support project team to scale, monitor and operate data platforms
- TS/SCI clearance with a polygraph
- Bachelor’s degree
Benefits
- Health benefits
- Life benefits
- Disability benefits
- Financial benefits
- Retirement benefits
- Paid leave
- Professional development
- Tuition assistance
- Work-life programs
- Dependent care
