Software Developer/Engineer (Mid Level experience) philadelphia pa
ESRhealthcarePhiladelphia, Pennsylvania, United States
Posted February 11, 2026
Full Time
About the Company
ESRhealthcare is a staffing firm that connects qualified professionals with executive, healthcare, and IT positions. They provide executive, medical, IT, and special staffing placements, leveraging a broad network of partners to source real job opportunities. Candidates undergo rigorous pre‑screening to ensure optimal matches, and the firm maintains strict confidentiality by submitting personal data only after client approval. ESRhealthcare’s proactive communication and 24/7 availability keep candidates informed throughout the search, while they avoid contacting current employers, focusing on references once a suitable role is identified.
Job Description
Software Developer/Engineer position with Mid Level experience required for hybrid work environment. Hands-on experience deploying open-source LLMs, strong proficiency in Python, and experience with CPU-based inference, model quantization, and performance tuning required. Location: Philadelphia, PA.
Requirements
- Hands-on experience deploying open-source LLMs such as Meta Llama 3 and Mistral / Mixtral in on-prem or private environments
- Strong proficiency in Python for LLM inference, prompt engineering, and integration
- Experience with CPU-based inference, model quantization, and performance tuning
- Practical experience with open-source vector databases such as Qdrant, Chroma, Milvus, or pgvector
- Proven implementation of Retrieval-Augmented Generation (RAG) pipelines
- Experience generating and managing embeddings and metadata filtering
- Understanding of data privacy, air-gapped deployments, and enterprise security requirements
- Experience implementing access controls and audit logging