Databricks Data Engineer

Our client provides data-driven solutions to business problems through statistical data mining and analytics techniques. They are seeking a Databricks Data Engineer to design and develop data systems, implement solutions, and advise stakeholders on data cloud platform architecture optimization.

Requirements

• 5+ years experience in architecture, design, and implementation using Databricks
• Experience in designing and implementing scalable, fault-tolerant systems
• Deep understanding of one or more of the big data computing technologies such as Databricks, snowflake
• In-depth knowledge of spark internals, catalyst optimization, and Databricks runtime environment
• Experience in implementing solutions using Databricks
• Experience in Insurance (P&C) is good to have
• Programming Languages SQL, Python
• Technologies Databricks, Delta Lake storage, Spark (PySpark, Spark SQL)
• Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure DevOps