T&T | Engineering| Databricks + Pyspark

Deloitte is seeking a highly skilled Databricks Data Engineer to join their data modernization team. The ideal candidate will design, develop, and maintain robust data solutions on the Databricks platform, driving data-driven decision-making across various customers.

Requirements

• Design, develop, and optimize data workflows and notebooks using Databricks to ingest, transform, and load data from various sources into the data lake.
• Build and maintain scalable and efficient data processing workflows using Spark (PySpark or Spark SQL) by following coding standards and best practices.
• Collaborate with technical and business stakeholders to understand data requirements and translate them into technical solutions.
• Develop data models and schemas to support reporting and analytics needs.
• Ensure data quality, integrity, and security by implementing appropriate checks and controls.
• Monitor and optimize data processing performance, identifying, and resolving bottlenecks.
• Stay up to date with the latest advancements in data engineering and Databricks technologies.

Benefits

• Competitive salary
• Opportunities for professional growth and development
• Collaborative and dynamic work environment
• Recognition and rewards for outstanding performance
• Access to the latest technology and tools
• Comprehensive benefits package
• Flexible work arrangements