Software Engineer, LLM Infrastructure
OpenReqCupertino, California, United States
Posted June 5, 2024
Full Time
About the Company
Etched believes in the Bitter Lesson, and thinks most of the progress in the AI field has come from using more FLOPs to train and run models.
Job Description
Etched is building AI chips that are hard-coded for individual model architectures. As a Software Engineer, LLM Infrastructure, you will help make a serving stack work with single-digit millisecond latency, and develop software for continuous batching and interactive documentation.
Requirements
- 3+ years of software engineering experience
- Good at math and communicating mathematical ideas
- Results-oriented and bias towards shipping products
- Willing to learn about machine learning research
Benefits
- Full medical, dental, and vision packages
- 100% premium coverage for self, 90% for dependents
- Housing subsidy of $2,000/month
- Daily lunch and dinner in the office
- Relocation support for those moving to Cupertino