The Knights of Columbus is seeking a Data Movement Engineer (Snowflake) - Contractor to provide production support to existing and future ETL environments and lead the design, optimization, and support framework of Snowflake-based data solutions.
Requirements
- Manage the full lifecycle of Snowflake data operations, including monitoring, troubleshooting, and optimizing data pipelines.
- Develop and optimize SQL queries, warehouse configurations, and data models for performance, reliability, and scalability.
- Design, develop, and optimize Snowflake data pipelines and models.
- Support advanced features like Change Data Capture (CDC) and Slowly Changing Dimensions (SCD Type 2).
- Support frameworks like Data Vault and dimensional modeling in Snowflake.
- Perform root cause analysis of data discrepancies, latency, and integrity issues.
- Provide production support for IBM DB2, Snowflake, and orchestration tools (Airflow, ESP).
- Collaborate with other teams to implement fixes and preventive measures.
- Perform data quality analysis, report issues, and propose solutions.
- Implement validation and reconciliation checks within pipelines.
- Support data governance initiatives including metadata management and lineage tracking.
- Provide technical leadership, code reviews, and mentorship to junior developers.
- Coordinate with business stakeholders, data architects, and application teams to gather requirements and deliver solutions.
- Communicate issue status, impact, and resolution timelines effectively.
- Maintain comprehensive documentation for all Snowflake-related issues, fixes, and scripts, ensuring they are version-controlled and aligned with data architecture and security standards.
- Develop and maintain production support playbooks and detailed ticket resolution procedures to enable consistent and efficient incident handling.
- Prepare effort estimations and contribute to architectural decisions.
- Provide regular updates and reports on issue trends and improvement initiatives.
- On-call and/or after-hours work required.
Benefits
- Paid Time Off
- 401k Matching
- Retirement Plan