Software Engineer - Distributed Training Infrastructure

Clockwork.io is a Silicon Valley startup that delivers state-of-the-art AI compute acceleration. We are looking for an experienced software engineer to help build, optimize, and maintain large-scale distributed training infrastructure based on the PyTorch ecosystem.

Requirements

• Deep experience with PyTorch and torch.distributed (c10d)
• Hands-on experience with at least one of: Megatron-LM, DeepSpeed, or FairScale
• Proficiency in Python and Linux shell scripting
• Experience with multi-node GPU clusters using Slurm, Kubernetes, or similar
• Strong understanding of NCCL, collective communication, and GPU topology
• Familiarity with debugging tools and techniques for distributed systems

Benefits

• Competitive compensation
• A great benefits package
• Catered lunch