Member of Technical Staff, Post training team

We're a team of researchers, engineers, and designers passionate about building AI systems. We're looking for a Member of Technical Staff to advance the state of the art for model post training and ship state of the art models to production.

Requirements

• Design and write high-performant and scalable software for training models
• Consistently post-train the models to reach SOTA level performance
• Coordinate with other specialist teams to produce models that have strong all encompassing performance
• Craft and implement techniques to improve the performance and results of our training cycles
• Research, implement, and experiment with ideas on our supercompute and data infrastructure
• Proficiency in Python and related ML frameworks such as JAX, Pytorch and XLA/MLIR
• Experience with distributed training infrastructures (Kubernetes, Slurm) and associated frameworks (Ray)
• Experience using large-scale distributed training strategies
• Hands on experience on training large model at scale
• Hands on experience with the post training phase of model training, with a strong emphasis on performance optimisation

Benefits

• An open and inclusive culture and work environment
• Work closely with a team on the cutting edge of AI research
• Weekly lunch stipend, in-office lunches & snacks
• Full health and dental benefits, including a separate budget to take care of your mental health
• 100% Parental Leave top-up for 6 months for employees based in Canada, the US, and the UK
• Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
• Remote-flexible, offices in Toronto, New York, San Francisco and London and co-working stipend
• 6 weeks of vacation