We are seeking an experienced Resident Solution Architect to join our Professional Services team and work directly with strategic customers on their data and AI transformation initiatives using the Databricks platform.
Requirements
- 10+ years of experience with Big Data Technologies such as Apache SparkTM, Kafka, and Data Lakes in a customer-facing post-sales, technical architecture, or consulting role.
- 4+ years of experience as a Solution Architect creating designs, solving Big Data challenges for customers.
- Expertise in Apache Spark, distributed computing, and Databricks platform capabilities
- Comfortable writing code in Python, PySpark, and Scala.
- Exceptional SQL, Spark SQL, Spark-streaming skills.
- Advanced knowledge of Spark optimizations, Delta, Databricks Lakehouse Platforms
- Expertise in Azure.
- Expertise in NoSQL databases (MongoDB, Redis, HBase)
- Expertise in data governance and security (Unity Catalog, RBAC).
- Ability to work with Partner Organization and deliver complex programs.
- Ability to lead large technical delivery teams.
- Understands the larger competitive landscape, such as EMR, Snowflake, and Sagemaker.
- Experience of migration from On-prem / Cloud to Databricks is a plus.
- Excellent communication and client-facing consulting skills, with the ability to simplify complex technical concepts.
- Willingness to travel for onsite customer engagements within India.
- Documentation and white-boarding skills.
- Experience with ML libraries/frameworks: Scikit-learn, TensorFlow, PyTorch.
- Familiarity with MLOps tools and processes, including MLflow for tracking and deployment.
- Experience delivering LLM and GenAI solutions at scale (RAG architectures, prompt engineering).
- Extensive experience on Hadoop, Trino, Ranger and other open-source technology stack.
- Expertise on cloud platforms like AWS and GCP.
Benefits
- Benefits at Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit https://www.mybenefitsnow.com/databricks.
