LLM Pre-training & Distributed Engineer (AI Infrastructure)

We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer to orchestrate large-scale machine learning training runs and optimize distributed infrastructure.

Requirements

• Orchestrating distributed training runs across 1,000+ GPUs using PyTorch, DeepSpeed, or Megatron-LM.
• Optimizing networking (InfiniBand/RDMA) and memory management to prevent out-of-memory errors.
• Automating checkpointing and failure recovery during month-long training runs.

Benefits

• Generous Paid Time Off
• 401k Matching
• Retirement Plan