High Performance Computing (HPC) Engineer

Newly established startup in Silicon Valley dedicated to transforming biology and medicine through Generative AI. The company pioneers pan-modal Large Biological Models (LBM) and seeks a High Performance Computing (HPC) Engineer to design, deploy, and maintain high-performance GPU clusters, implement distributed computing techniques, and optimize performance for deep learning models. The role will also involve troubleshooting, documentation, and collaboration with data scientists and machine learning engineers.

Requirements

• Master’s or Ph.D. degree in computer science, or a related field with a focus on High-Performance Computing, Distributed Systems, or Deep Learning.
• 2+ years proven experience in managing GPU clusters, including installation, configuration, and optimization.
• Strong expertise in distributed deep learning and parallel training techniques.
• Proficiency in popular deep learning frameworks like PyTorch, Megatron-LM, DeepSpeed, etc.
• Programming skills in Python and experience with GPU-accelerated libraries (e.g., CUDA, cuDNN).
• Knowledge of performance profiling and optimization tools for HPC and deep learning.
• Familiarity with resource management and scheduling systems (e.g., SLURM, Kubernetes)
• Strong background in distributed systems, cloud computing (AWS, GCP), and containerization (Docker, Kubernetes)

Benefits

• Equal opportunity employer
• Inclusive environment