Research Scientist / Engineer – Performance Optimization
Luma AIPalo Alto, California, United States • United States
Posted February 20, 2025
Full Time
About the Company
Lumalabs is a pioneering research and design company that empowers individuals and organizations to visualize their ideas and bring them to life. With a focus on innovation and creativity, they offer a cutting-edge platform, Dream Machine, that enables users to explore and design their concepts in a unique and immersive way.
Job Description
The Performance Optimization team at Luma is dedicated to maximizing the efficiency and performance of our AI models. We are seeking a Research Scientist / Engineer to profile and optimize GPU/CPU/Accelerator code for maximum utilization and minimal latency, and to develop fused kernels and leverage tensor cores and modern hardware features for optimal hardware utilization on different hardware platforms.
Requirements
- Expert-level proficiency in Triton/CUDA programming and GPU optimization
- Strong PyTorch skills
- Experience with PyTorch kernel development and custom operations
- Proficiency with profiling tools (NVIDIA Nsight, torch profiler, custom tooling)
- Deep understanding of transformer architectures and attention mechanisms