Software Engineer, Data Infrastructure - Research

The Workload team at OpenAI is responsible for designing and running the infrastructure that powers LLM training and inference. This role focuses on building standardized dataset interfaces, scaling pipelines across GPUs, and collaborating with researchers to ensure efficient, high-quality datasets. The engineer will contribute to the development of new datasets, improve existing ones, and maintain the data pipeline as it evolves. This role is crucial for ensuring the scalability and reliability of OpenAI’s training infrastructure.

Requirements

• Strong engineering fundamentals with experience in distributed systems, data pipelines, or infrastructure.
• Experience building APIs and scalable abstractions.
• Comfort debugging bottlenecks across large fleets of machines.