Senior Software Engineer, AIOps & Infrastructure

Role Overview

As a Senior Software Engineer, AIOps & Infrastructure at Eloquent AI, you will be responsible for designing, building, and optimizing scalable, high-performance AI infrastructure to support the deployment and operation of our enterprise AI agents.

What You Will Do

Design and build scalable ML infrastructure for deploying and maintaining AI agents in production, automate LLMOps and MLOps workflows, optimize GPU and cloud compute workloads, develop Kubernetes-based solutions, and improve system observability and reliability.

Why It Might Be a Fit

This role requires deep expertise in cloud infrastructure, Kubernetes, and LLM and ML deployment pipelines. If you’re passionate about scalable AI systems and optimizing ML models for real-world applications, this is your opportunity to work at the frontier of LLMOps.

Requirements

• 5+ years of experience in software engineering, MLOps, or infrastructure development
• Strong expertise in Kubernetes and experience managing containerized ML workloads
• Deep understanding of cloud platforms (AWS, GCP, Azure) and distributed computing
• Proficiency in Python, with experience developing services for ML/AI applications
• Experience with ML model deployment pipelines, including model serving, inference optimization, and monitoring