
Job description
This role focuses on building and operating the ML Ops / LLM Ops pipeline that closes the loop: ingest production signal, redact it, store it, slice it, classify it, surface the failures, mine new eval cases, and alert on regressions.
Design and build a source-agnostic ingestion pipeline for production ML / LLM traffic, design storage tiering, build slicing dashboards, enable autoraters, and implement PII redaction.
Must have proven experience building and operating data or ML platform systems in production, hands-on experience building and running ML / LLM evaluation systems, and strong understanding of how ML and LLM-based systems fail in production.
Company
Keep exploring
Sign in to see similar jobs
Create a free account to discover roles related to this posting.

Tech, Software & IT Services
Caixa Mágica Software is a leading Portuguese technology company specializing in open-source solutions for public and private sector clients across Europe. Founded in 2000, the company offers a comprehensive suite of services including open-source consultancy and development, embedded systems, cloud and mobile application development, and digital identity solutions. They are also the official LPI certification provider in Portugal. Caixa Mágica Software distinguishes itself through a commitment to collaborative innovation, delivering sustainable, secure, and future-ready technologies. Beyond development, they provide talent augmentation, nearshore outsourcing, UX/UI design, and emerging technology services like AI and Machine Learning, making them a versatile partner for organizations seeking expert IT solutions and skilled technical teams.