Ruby Labs is looking for a Senior AI Engineer to join their team and help advance their AI infrastructure. The role involves working with a modern tech stack, focusing on model performance, reliability, and cost efficiency. Key responsibilities include advanced prompt engineering, structured outputs and schemas, and AI A/B testing.
Requirements
- Node.js & Next.js: Deep knowledge of the stack to build reliable services and handle complex LLM-generated data.
- Dynamic Prompting Skills: Proven experience in building prompts where content is highly dependent on input variables and context injection.
- OpenRouter Experience: Experience working with unified APIs, managing rate limits, and selecting the most cost-effective models for specific tasks.
- Langfuse (or similar): Understanding of LLM observability principles — setting up tracing, creating test datasets, and integrating scoring systems.
- Evaluation Methodology: Experience with frameworks like RAGAS or building custom “LLM-as-a-judge” systems.
- Analytical Mindset: Ability to transform raw generation logs into actionable business metrics and technical insights.
- Iterative Mindset: Focus on continuous product improvement through constant feedback loops.
- Fluency in Russian and/or Ukrainian.
Benefits
- Remote Work Environment
- Unlimited PTO
- Paid National Holidays
- Company-provided MacBook
- Flexible Independent Contractor Agreement
