As a Data Engineer Specialist on the Innovation and Automation team, you will serve as a subject matter expert, blending deep data engineering expertise with a passion for automation. You will design, develop, and implement the reusable frameworks, automated patterns, and core tooling that our data engineering teams will use to build their own pipelines faster, more reliably, and more consistently.
Requirements
- Act as a technical expert on the design and implementation of automated data engineering solutions
- Develop and maintain a library of standardized, reusable ETL/ELT pipeline templates using Python, SQL, and frameworks like Databricks or Snowflake
- Engineer and implement robust, automated data quality and testing frameworks (e.g., using tools like Great Expectations) that are embedded within the core pipeline templates
- Contribute to the development of Infrastructure-as-Code (IaC) modules (Terraform) for the automated provisioning of data infrastructure
- Enhance and optimize the CI/CD for Data (DataOps) pipelines, ensuring seamless and reliable deployment of data workflows
- Serve as an escalation point for the most complex data engineering and automation challenges, providing expert-level troubleshooting and guidance to other engineers
- Mentor other data engineers on automation best practices, code standards, and the use of the frameworks you build
- Research and prototype cutting-edge data engineering and automation technologies to drive continuous improvement
Benefits
- 401k Matching
- Retirement Plan
- Generous Paid Time Off
- Tuition Reimbursement
- Relocation Assistance