We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference systems. This position is focused on designing, implementing, and delivering production-grade software that powers real-world applications of Large Language Models (LLMs) and Vision-Language Models (VLMs).
Requirements
- 5+ years of hands-on software development experience in building and optimizing AI inference systems at scale.
- Direct experience in LLM/VLM model internals, including Transformer-based architectures, inference bottlenecks, and optimization techniques.
- Strong expertise in performance engineering: kernel development, parallelism strategies, memory optimization, and distributed inference systems.
- Proficiency with GPU/NPU programming (CUDA, or vendor-specific SDKs), compiler toolchains, and deep learning frameworks (PyTorch, or TensorFlow).
- Strong programming skills in C/C++, with a track record of delivering high-performance, production-grade software.
- Solid foundation in computer architecture, systems programming (CPU/GPU pipelines, memory hierarchy, scheduling), and embedded systems.
Benefits
- CIGNA EPO, HSA, and Kaiser HMO medical plans with $0 for Employee Only Coverage.
- Dental (including orthodontic coverage) and vision plan. Both provide options with a $0 paycheck contribution covering you and your eligible dependents.
- Company Paid HSA (Health Savings Account) Contribution when enrolled in the High Deductible CIGNA medical plan
- Healthcare and Dependent Care Flexible Spending Accounts (FSA)
- 401(k) with Brokerage Link option
- Company paid Basic Life, AD&D, short-term and long-term disability insurance
- Employee Assistance Program
- Sick and Vacation time
- 13 Paid Holidays a year
- Paid Parental Leave for first 8 weeks at full pay (eligible after 90 days of employment with NIO)
- Paid Disability Leave for first 6 weeks at full pay (eligible after 90 days of employment with NIO)
- Voluntary benefits including: Voluntary Life and AD&D options for you, your spouse/domestic partner and dependent child(ren), pet insurance
- Commuter benefits
- Mobile Cell Phone Credit
- Healthjoy mobile benefit app supporting you and your dependents with benefit questions on the go & support with benefit billing questions
- Free lunch and snacks
- Onsite gym
- Employee discounts and perks program
