Senior Software Engineer, AI

Senior Software Engineer, AI position at Lattice. The successful candidate will design and ship a robust AI evaluation framework, define and instrument metrics, and build and maintain evaluation datasets.

Requirements

• 5+ years of professional software engineering experience with significant time spent on production AI/ML systems.
• Deep hands-on experience with LLM-based systems: prompt engineering, RAG pipelines, agent orchestration, evaluation metrics, and model fine-tuning.
• Proven ability to work with data and understand statistics, especially in experiments.
• Proven ability to build and operate agentic AI systems in production: multi-step workflows, multi-agent topologies, and the failure modes that come with them.
• Strong command of AI evaluation: you’ve built eval frameworks before, you know the difference between a good eval and a vanity metric, and you have opinions about it.
• Production-grade Python engineering: clean, maintainable, testable code.
• LangGraph or comparable agent orchestration frameworks.
• LangSmith or comparable LLM observability tooling for tracing, evaluation, and debugging.
• Vector databases (Pinecone or similar) and retrieval system design.
• AWS ecosystem or other cloud infrastructure (ex GCP). Comfortable with lambdas, queues, and cloud-native architecture.
• Familiarity with TypeScript is a plus.

Benefits

• Medical insurance
• Dental insurance
• Life, AD&D, and Disability Insurance
• Natural Disaster Support Program
• Wellness Apps
• Paid Parental Leave
• Paid Time off inclusive of holidays and sick time
• Working Remotely Stipend
• One time WFH Office Set-Up Stipend
• Retirement Plan
• Financial Planning
• Learning & Development Budget