As the Sr. Principal Data Engineer / Data Architect, you will design and oversee the migration/optimization of our data lakehouse architecture using Databricks. You will be responsible for bridging the gap between business priorities and technical execution, ensuring our "Partner" integrations are scalable, cost-efficient, and resilient.
Requirements
- Architectural Leadership: Design and oversee the migration/optimization of our data lakehouse architecture using Databricks.
- Production Excellence: Serve as the escalation point for the platform, leveraging a proven record of handling production issues to ensure 24/7 reliability of mission-critical pipelines.
- Strategic Capacity Planning: Work directly with the SVP of Tech to translate product roadmaps into technical requirements.
- Infrastructure as Code: Drive the adoption of Databricks Asset Bundles (DABs) to standardize deployments across dev, staging, and production.
- Mentorship & Governance: Provide high-level guidance to engineering squads in India and the US, defining schemas and governance models for BigQuery and Databricks.
Benefits
- Participation in a retirement plan
- Quarterly and annual incentive plan bonuses
- Life and disability insurance
- Health, dental and vision plans
- Flexible spending accounts
- 15 paid vacation days
- 2 paid personal days
- 9 paid holidays
- 40 hours of paid sick leave
- Parental leave
- Employee stock purchase plan