Senior Software Engineer, Go - LLM Team

AssemblyAI is a startup building powerful models for speech-to-text and speech understanding available through a straightforward API. We're seeking a Senior Software Engineer to join our LLM team, focusing on building and maintaining our LLM gateway service, a unified API platform that connects customers to multiple LLM providers.

Requirements

• 5+ years of professional software engineering experience
• Strong proficiency in Go with demonstrated ability to write production-quality code
• Hands-on experience with LLM APIs (OpenAI, Anthropic, etc.) and understanding of prompt engineering concepts
• Experience building or working with API gateways, proxies, and rate limiting systems
• Deep experience with prompt engineering, chain-of-thought, few-shot learning, and other LLM optimization techniques
• Experience building applications with llms or ai agents with cascading architectures
• Solid understanding of software engineering fundamentals: data structures and algorithms, system design and architectural patterns, testing strategies, code review practices, and technical collaboration
• Experience with RESTful APIs and distributed systems concepts, building or integrating with third-party APIs, SQL and database design, version control (Git) and CI/CD pipelines, containerization (Docker) and cloud infrastructure
• Strong communication skills and ability to collaborate effectively with cross-functional teams
• Track record of delivering high-quality, reliable software in a fast-paced, team environment

Benefits

• 100% employer-paid benefits
• Competitive equity grants
• Flexible work arrangements (fully remote)
• Opportunities for professional growth and development