We are seeking a Data Engineering Manager to join a high-impact Customer Insights product engagement for a global QSR client. The ideal candidate brings deep expertise in Databricks, Spark (PySpark), SQL, and large-scale identity resolution pipelines, and thrives in complex, production-ready data environments.
Requirements
- 5+ years of experience in Data Engineering building production-grade data pipelines at scale.
- Strong hands-on experience with Databricks and Apache Spark (PySpark preferred).
- Advanced SQL skills (complex joins, CTEs, window functions, performance tuning).
- Experience developing identity resolution or entity matching pipelines (deterministic and/or probabilistic).
- Experience designing and implementing data marts or dimensional models (Kimball or similar).
- Familiarity with data quality frameworks (schema drift detection, validation, anomaly monitoring).
- Experience implementing CI/CD for data pipelines and managing multi-environment deployments.
- Strong communication skills and ability to present technical concepts to non-technical stakeholders.
- Experience using Jira for ticket tracking and Confluence for documentation.
Benefits
- Generous Paid Time Off
- 401k Matching
- Retirement Plan
- Visa Sponsorship
- Four Day Work Week
- Generous Parental Leave
- Tuition Reimbursement
- Relocation Assistance