Member of Engineering (Pre-training / Data)

poolside exists to be one of the companies that will achieve human-level intelligence in AI. We're building a world where AI drives economically valuable work and scientific progress. The company focuses on building for a developer-led, increasingly AI-assisted world, and envisions a future where 2 billion people can build software.

Requirements

• Strong machine learning and engineering background
• Experience with Large Language Models (LLM)
• Good knowledge of Transformers
• Knowledge/Experience with cutting-edge training tricks
• Knowledge/Experience of distributed training
• Trained LLMs from scratch
• Knowledge of deep learning fundamentals
• Experience in building trillion-scale pretraining datasets
• Experience working with large-scale GPU clusters and distributed data pipelines
• Strong obsession with data quality
• Research experience
• Programming experience
• Strong algorithmic skills
• Linux
• Git, Docker, k8s, cloud managed services
• Data pipelines and queues
• Python with PyTorch or Jax

Benefits

• Fully remote work & flexible hours
• 37 days/year of vacation & holidays
• Health insurance allowance for you and dependents
• Company-provided equipment
• Wellbeing, always-be-learning and home office allowances
• Frequent team get togethers
• Great diverse & inclusive people-first culture