Senior Software Engineer - Model Performance
InferenceSan Francisco, California, United States
Posted January 21, 2026
220000 - 320000 USD year
Full Time
About the Company
Inference specializes in enterprise decision management, offering a suite of products and consulting services that operationalize big‑data analytics through predictive modeling and advanced decision architectures. With over a decade of experience, the company delivers solutions such as a .NET Rules Engine, Business Rules Management System (BRMS), and comprehensive decision‑management services. Its client‑centric philosophy—prioritizing client interests, fostering honest dialogue, and committing only to high‑quality, essential work—distinguishes Inference in a competitive analytics landscape. The firm’s blend of technical expertise and principled consulting makes it an attractive partner for organizations seeking reliable, data‑driven decision support.
Job Description
Help us make inference blazingly fast by implementing and productionizing optimization techniques, experimenting with novel approaches, and working across the full inference stack.
Requirements
- 2+ years of experience in ML systems, inference optimization, or GPU programming
- Strong proficiency in Python and familiarity with C++
- Hands-on experience with LLM inference frameworks (vLLM, SGLang, TensorRT-LLM, or similar)
- Deep understanding of GPU architecture and experience profiling GPU workloads
- Familiarity with LLM optimization techniques (quantization, speculative decoding, continuous batching, KV cache management)
- Experience with PyTorch and understanding of how models execute on hardware
- Track record of measurably improving system performance
Benefits
- Competitive compensation
- Equity in a high-growth startup
- Comprehensive benefits