Senior Software Engineer, AI Inference Systems
NVIDIAToronto, Ontario, Canada
Posted January 23, 2026
170000 - 275000 CAD
Full Time
About the Company
NVIDIA is a leader in AI research and development, with a mission to advance AI research and create groundbreaking technologies that enable anyone to harness the power of AI.
Job Description
We are seeking a Senior Software Engineer to build AI inference systems that serve large-scale models with extreme efficiency. You will architect and implement high-performance inference stacks, optimize GPU kernels and compilers, and collaborate across teams to push the frontier of accelerated computing for AI.
Requirements
- Bachelor’s degree (or equivalent experience) in Computer Science (CS), Computer Engineering (CE) or Software Engineering (SE) with 7+ years of experience
- Strong programming skills in Python and C/C++; experience with Go or Rust is a plus
- Solid CS fundamentals: algorithms & data structures, operating systems, computer architecture, parallel programming, distributed systems, deep learning theories
- Knowledgeable and passionate about performance engineering in ML frameworks (e.g., PyTorch) and inference engines (e.g., vLLM and SGLang)
- Familiarity with GPU programming and performance: CUDA, memory hierarchy, streams, NCCL; proficiency with profiling/debug tools (e.g., Nsight Systems/Compute)
Benefits
- Eligible for equity
- Benefits