AI Infrastructure Engineer
UtilidataUnited States
Posted April 14, 2026
170000 - 210000 USD
Full Time
About the Company
Utilidata is an AI-powered technology company specializing in edge computing solutions for the electric grid. Utilizing NVIDIA's infrastructure, their Karman platform enables real-time data processing and AI training at the grid edge, transforming utility operations through smart meters and advanced analytics. The company's mission-driven team brings diverse expertise in electrical engineering, software development, and energy policy to drive innovation and sustainability in the energy sector.
Job Description
Utilidata is a fast-growing NVIDIA-backed edge AI company enabling greater visibility and control of power utilization in energy-intensive infrastructure, like the electric grid and data centers. The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end infrastructure that serves Utilidata's AI and ML models across edge deployments, cloud environments, and data center integrations.
Requirements
- 5+ years of software engineering experience with a strong focus on AI infrastructure, backend systems, or distributed systems
- Hands-on experience with AI model serving frameworks
- Understanding of container orchestration and cluster management
- Experience deploying and operating infrastructure across both datacenter and on-prem environments
- Strong knowledge of GPU workloads and the tradeoffs that come with them
- Proficiency in Python; C++, CUDA, Go, Rust a plus
- Excellent communication skills and comfort working cross-functionally in a lean, fast-moving environment
Benefits
- Flexible paid time off
- Competitive compensation
- Benefits, including health, dental, vision
- Employer-match 401k
