Data Engineer

Bridging the gap between complex insurance business logic and modern cloud data architecture, designing and implementing end-to-end data solutions for policy, claims, and billing data, leveraging Medallion Architecture and Unity Catalog.

Requirements

• Design and implement end-to-end data solutions
• Develop and maintain robust ETL/ELT pipelines using PySpark and Databricks
• Implement and manage data governance, lineage, and fine-grained access control
• Optimize complex SQL queries and Spark jobs for performance and cost-efficiency
• Lead the transition from legacy data warehouses to a modern Lakehouse architecture
• Partner with Actuarial and Finance teams to translate complex insurance business rules into technical data models
• Build and maintain CI/CD pipelines for data workloads using Azure DevOps or GitHub Actions
• Implement proactive monitoring and alerting for data quality and pipeline health

Benefits

• Paid time off
• 401k matching
• Retirement plan
• Health insurance
• Dental insurance
• Vision insurance