Research Scientist / Engineer – Training Infrastructure

Luma is seeking a Research Scientist / Engineer to join their Training Infrastructure team. The team builds and maintains distributed systems for training large-scale multimodal models across thousands of GPUs.

Requirements

• Design, implement, and optimize efficient distributed training systems for models with thousands of GPUs
• Research and implement advanced parallelization techniques (FSDP, Tensor Parallel, Pipeline Parallel, Expert Parallel)
• Build monitoring, visualization, and debugging tools for large-scale training runs
• Optimize training stability, convergence, and resource utilization across massive clusters