The Senior Software Engineer, AI role at Lattice is responsible for designing and shipping a robust AI evaluation framework, architecting reusable agent infrastructure, and contributing to production AI systems. The ideal candidate will have 5+ years of professional software engineering experience with significant time spent on production AI/ML systems, and strong hands-on experience with LLM-based systems and AI evaluation.
Requirements
- Experience with LLM-based systems: prompt engineering, RAG pipelines, agent orchestration, evaluation metrics, and model fine-tuning.
- Proven ability to work with data and understand statistics, especially in experiments.
- Strong command of AI evaluation: building eval frameworks, understanding the difference between a good eval and a vanity metric, and having opinions about it.
- Production-grade Python engineering: clean, maintainable, testable code.
- LangGraph or comparable agent orchestration frameworks.
- LangSmith or comparable LLM observability tooling for tracing, evaluation, and debugging.
- Vector databases (Pinecone or similar) and retrieval system design.
- AWS ecosystem or other cloud infrastructure (ex GCP). Comfortable with lambdas, queues, and cloud-native architecture.
- Familiarity with TypeScript is a plus.
Benefits
- Medical insurance
- Dental insurance
- Vision insurance
- Life, AD&D, and Disability Insurance
- Emergency Weather Support
- Wellness Apps
- Paid Parental Leave
- Paid Time off inclusive of holidays and sick time
- Commuter & Parking Accounts
- Lunches in the Office
- Internet and Phone Stipend
- 401(k) retirement plan
- Financial Planning
- Learning & Development Budget