poolside exists to be one of the companies that will achieve human-level intelligence in AI. We're building a world where AI drives economically valuable work and scientific progress. The company focuses on building for a developer-led, increasingly AI-assisted world, and envisions a future where 2 billion people can build software.
Requirements
- Strong machine learning and engineering background
- Experience with Large Language Models (LLM)
- Good knowledge of Transformers
- Knowledge/Experience with cutting-edge training tricks
- Knowledge/Experience of distributed training
- Trained LLMs from scratch
- Knowledge of deep learning fundamentals
- Experience in building trillion-scale pretraining datasets
- Experience working with large-scale GPU clusters and distributed data pipelines
- Strong obsession with data quality
- Research experience
- Programming experience
- Strong algorithmic skills
- Linux
- Git, Docker, k8s, cloud managed services
- Data pipelines and queues
- Python with PyTorch or Jax
Benefits
- Fully remote work & flexible hours
- 37 days/year of vacation & holidays
- Health insurance allowance for you and dependents
- Company-provided equipment
- Wellbeing, always-be-learning and home office allowances
- Frequent team get togethers
- Great diverse & inclusive people-first culture