LLM Inference Engineer

Hippocratic AI is seeking an LLM Inference Engineer to optimize their large language model serving infrastructure. The ideal candidate has extensive hands-on experience with state-of-the-art inference optimization techniques and a track record of deploying efficient, scalable LLM systems in production environments.

Requirements

• Extensive hands-on experience with state-of-the-art inference optimization techniques
• Proven expertise with distributed serving architectures for large language models
• Hands-on experience implementing quantization techniques for transformer models
• Strong understanding of modern inference optimization methods
• Proficiency in Python and C++
• Experience with CUDA programming and GPU optimization

Benefits

• Competitive salary
• Benefits package
• Opportunities for growth and development
• Collaborative and dynamic work environment