We're seeking a Data Engineer to take the lead in building our data pipelines and core tables for OpenAI. The role requires 3+ years of experience as a data engineer and 8+ years of software engineering experience. The team works across research, engineering, product, and design to bring OpenAI's technology to consumers and businesses.
Requirements
- 3+ years of experience as a data engineer
- 8+ years of any software engineering experience(including data engineering)
- Proficiency in at least one programming language commonly used within Data Engineering
- Experience with distributed processing technologies and frameworks
- Expertise with ETL schedulers such as Airflow, Dagster, Prefect or similar frameworks
- Solid understanding of Spark and ability to write, debug and optimize Spark code
Benefits
- Relocation assistance
- Full-time employment
- Equal opportunity employer
- Reasonable accommodations to applicants with disabilities