Ares seeks a Vice President, Data Engineering to own critical data pipelines and establish architectural patterns for our Databricks-on-Azure data platform. The successful candidate will design and build complex Spark SQL and Python-based ETL/ELT pipelines, master Delta Lake architecture, and optimize Databricks cluster configurations.
Requirements
- 6-9 years of data engineering experience with 2+ years at senior level or equivalent complexity
- Expert-level proficiency in Databricks/Delta Lake: notebook development, SQL, Spark, performance tuning
- Advanced SQL expertise: complex joins, window functions, CTEs, query optimization
- Strong Python proficiency: PySpark, pandas, data validation libraries
- Proven experience building ETL/ELT pipelines at scale (100GB+ datasets, multi-source ingestion)
- Deep understanding of Delta Lake: transactions, ACID properties, schema evolution, merge operations
- Experience with Azure cloud services: ADLS, Azure SQL, Event Hubs, blob storage, Azure Key Vault
- Demonstrated experience with document and unstructured data processing
- Experience with data orchestration tools (Prefect, Airflow, Databricks Workflows) and building robust error handling
Benefits
- Comprehensive Medical/Rx, Dental and Vision plans
- 401(k) program with company match
- Flexible Savings Accounts (FSA)
- Healthcare Savings Accounts (HSA) with company contribution
- Basic and Voluntary Life Insurance
- Long-Term Disability (LTD) and Short-Term Disability (STD) insurance
- Employee Assistance Program (EAP)
- Commuter Benefits plan for parking and transit
- Access to a world-class medical advisory team
- Mental health app with coaching, therapy, and psychiatry
- Mindfulness and wellbeing app
- Financial wellness benefit with access to a financial advisor
- New parent leave
- Reproductive and adoption assistance
- Emergency backup care
- Matching gift program
- Education sponsorship program