AssemblyAI is a startup building powerful models for speech-to-text and speech understanding available through a straightforward API. We're seeking a Senior Software Engineer to join our LLM team, focusing on building and maintaining our LLM gateway service, a unified API platform that connects customers to multiple LLM providers.
Requirements
- 5+ years of professional software engineering experience
- Strong proficiency in Go with demonstrated ability to write production-quality code
- Hands-on experience with LLM APIs (OpenAI, Anthropic, etc.) and understanding of prompt engineering concepts
- Experience building or working with API gateways, proxies, and rate limiting systems
- Deep experience with prompt engineering, chain-of-thought, few-shot learning, and other LLM optimization techniques
- Experience building applications with llms or ai agents with cascading architectures
- Solid understanding of software engineering fundamentals: data structures and algorithms, system design and architectural patterns, testing strategies, code review practices, and technical collaboration
- Experience with RESTful APIs and distributed systems concepts, building or integrating with third-party APIs, SQL and database design, version control (Git) and CI/CD pipelines, containerization (Docker) and cloud infrastructure
- Strong communication skills and ability to collaborate effectively with cross-functional teams
- Track record of delivering high-quality, reliable software in a fast-paced, team environment
Benefits
- 100% employer-paid benefits
- Competitive equity grants
- Flexible work arrangements (fully remote)
- Opportunities for professional growth and development