Senior Data Infrastructure Engineer

Role Overview

We are looking for a Senior Data Infrastructure Engineer to build and scale the real-time data pipelines that power agent behavior analysis at production scale. This role is crucial for processing hundreds of thousands of traces per second, running LLM-based scoring and clustering in near-real time, and delivering the low-latency query performance that enables teams to understand agent behavior as it happens.

What You Will Do

Design and automate large-scale, high-performance streaming and batch data processing systems to power Judgment's behavioral analysis products. Partner closely with infrastructure and backend partners to improve scalability, data governance, and efficiency.

Why It Might Be a Fit

6+ years of relevant industry experience building and operating high-throughput, petabyte-scale data pipelines in production. Experience collaborating with infrastructure, backend, and product partners to align on data flow and system design.

Requirements

• 6+ years of relevant industry experience building and operating high-throughput, petabyte-scale data pipelines in production
• Experience collaborating with infrastructure, backend, and product partners to align on data flow and system design
• Experience designing and deploying high-performance systems with reliable monitoring and observability practices
• Deep expertise with streaming and batching systems (Kafka, Spark, Flink, or Ray) operating at petabyte scale
• Hands-on OLAP database engineering experience, including with columnar databases (ClickHouse or similar) and distributed query engines (Presto or similar)
• Excellent communication skills, both written and verbal

Benefits

• Full benefits
• Equinox
• Private chef