Solutions Architect, Inference Deployments

We're looking for a Solutions Architect to develop enterprise AI solutions using NVIDIA GPU technology and Kubernetes. As a team member, you'll collaborate with engineering, DevOps, and customers to deliver generative AI to production.

Requirements

• 5+ Years in Solutions Architecture with a proven track record of deploying distributed systems and AI inference workloads on Kubernetes.
• Experience with one of NVIDIA Dynamo, Triton Inference Server, or TensorRT-LLM for model optimization and serving.
• GPU orchestration using NVIDIA GPU Operator, NIM Operator, and Multi-Instance GPU (MIG) partitioning.
• Solving sophisticated GPU allocation, memory hierarchies (HBM, DRAM, SSD), and low-latency networking (RDMA, UCX).
• Demonstrated success in tuning large language models for low-latency inference in enterprise environments.
• BS in CS/Engineering or equivalent experience.

Benefits

• Equity
• Benefits