NIO is looking for a senior AI Inference Infrastructure Software Engineer to design, implement, and deliver production-grade software that powers real-world applications of Large Language Models (LLMs) and Vision-Language Models (VLMs). The role involves shaping the architecture, roadmap, and performance of AI capabilities of the AIOS platform, driving innovations that make LLM/VLM systems fast, efficient, and scalable across cloud, edge, and hybrid edge-cloud environments.
Requirements
- 5+ years of hands-on software development experience in building and optimizing AI inference systems at scale
- Direct experience in LLM/VLM model internals, including Transformer-based architectures, inference bottlenecks, and optimization techniques
- Strong expertise in performance engineering: kernel development, parallelism strategies, memory optimization, and distributed inference systems
- Proficiency with GPU/NPU programming (CUDA, or vendor-specific SDKs), compiler toolchains, and deep learning frameworks (PyTorch, or TensorFlow)
- Strong programming skills in C/C++, with a track record of delivering high-performance, production-grade software
- Solid foundation in computer architecture, systems programming (CPU/GPU pipelines, memory hierarchy, scheduling), and embedded systems
- BS/MS in Computer Science, Computer Engineering, or related technical field
Benefits
- Anthem Blue Cross, HSA, and Kaiser HMO medical plans with $0 for Employee Only Coverage
- Dental (including orthodontic coverage) and vision plan
- Company Paid HSA (Health Savings Account) Contribution when enrolled in the High Deductible Anthem Blue Cross medical plan
- Healthcare and Dependent Care Flexible Spending Accounts (FSA)
- 401(k) with Brokerage Link option
- Company paid Basic Life, AD&D, short-term and long-term disability insurance
- Employee Assistance Program
- Sick and Vacation time
- 13 Paid Holidays a year
- Paid Parental Leave for first 8 weeks at full pay (eligible after 90 days of employment with NIO)
- Paid Disability Leave for first 6 weeks at full pay (eligible after 90 days of employment with NIO)
- Voluntary benefits including: Voluntary Life and AD&D options for you, your spouse/domestic partner and dependent child(ren), pet insurance
- Commuter benefits
- Mobile Cell Phone Credit
- Free lunch and snacks
- Onsite gym
- Employee discounts and perks program
