ML Engineer - Inference Serving

Luma’s mission is to build multimodal AI to expand human imagination and capabilities. We are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to affect change.

Requirements

• Ship new model architectures by integrating them into our inference engine
• Collaborate closely across research, engineering and infrastructure to streamline and optimize model efficiency and deployments
• Build internal tooling to measure, profile, and track the lifetime of inference jobs and workflows
• Automate, test and maintain our inference services to ensure maximum uptime and reliability
• Optimize deployment workflows to scale across thousands of machines
• Manage and optimize our inference workloads across different clusters & hardware providers
• Build sophisticated scheduling systems to optimally leverage our expensive GPU resources while meeting internal SLOs
• Build and maintain CI/CD pipelines for processing/optimizing model checkpoints, platform components, and SDKs for internal teams to integrate into our products/internal tooling