As a Manager, Data Engineer, you'll lead a small engineering team in designing, developing, and optimizing scalable data pipelines and platforms using Azure cloud services and Databricks. You'll be responsible for building robust data solutions that power analytics, reporting, and machine learning across the organization.
Requirements
- 6+ years of experience in data engineering
- 3+ years in a management role
- Strong focus on Azure cloud technologies
- Experience with Azure Databricks, Azure Data Lake, Data Factory, including PySpark, SQL, Python, and Delta Lake
- Strong proficiency in Databricks and Apache Spark
- Solid understanding of data warehousing, ETL/ELT, and data modeling best practices
- Experience with version control, CI/CD pipelines, and infrastructure as code
- Knowledge of Spark performance tuning, partitioning, and job orchestration
- Solid collaboration skills
- Experience mentoring and supporting teams
Benefits
- Medical, Dental and Vision insurance for you and your family
- Paid Time Off (PTO)
- 6 company-observed paid holidays, plus 3 paid floating holidays
- 401k (after 90 days) plus employer match up to 4%
- Pet Insurance for your furry family members
- Wellness perks
- Tuition Reimbursement
- Flexible Spending Accounts
- Life and AD&D Insurance
- Long-Term Disability and Short-Term Disability