Databricks Automation & AI Platform Engineer

We are seeking a senior Databricks Automation & AI Platform Engineer with deep expertise in Python, Databricks platform components, and AI/MLOps/LLMOps workflows. The engineer will support the Next‐Gen Platform Integration team by building automation frameworks, enabling scalable deployment workflows, and integrating AI capabilities across Databricks environments.

Requirements

• Strong hands‐on Python experience including: GIL behavior, Multiprocessing vs multithreading, Memory overhead trade‐offs, Data structure time complexities
• Deep understanding of Databricks ecosystem: Unity Catalog governance, Delta architecture (Bronze/Silver/Gold), MLflow tracking & model lifecycle, Mosaic AI Gateway & LLMOps workflows, Model Serving & Databricks Apps
• Experience with Docker image immutability, container state management, and environment reproducibility
• AWS Lambda, API Gateway, IAM, and automation pipelines
• Service Principal‐based authentication for secure Databricks automation
• Experience with platform engineering, deployment automation, and production stability patterns