Software Engineer — GPU Networking & Distributed Systems

Baseten is a company that powers mission-critical inference for dynamic AI companies. They are looking for a software engineer to lead their GPU Networking efforts and architect a software fabric that unifies thousands of GPUs into a cohesive operating system.

Requirements

• Deep experience with high-performance networking protocols (InfiniBand, RoCE v2)
• Fluency in C++ or Python
• Understanding of the memory hierarchy in modern NVIDIA architectures (H100/Blackwell)
• Ability to optimize for hardware

Benefits

• Competitive compensation
• 100% coverage of medical, dental, and vision insurance
• Generous PTO policy
• Paid parental leave
• Company-facilitated 401(k)