Senior Data Engineer

The Senior Data Engineer will play a key role in shaping data products that align with Metropolis' mission, collaborating with cross-functional teams to develop end-to-end data pipelines and foundational data sets. The role involves designing and owning data architecture for large-scale projects, building and optimizing sophisticated data pipelines, and implementing data security models.

Requirements

• Bachelor's degree in Computer Science, Computer Engineering, or a relevant technical field
• Master's degree preferred
• 5+ years of experience in data engineering, database engineering, business intelligence, data warehousing, and ETL tools, working with large data sets in the cloud
• 5+ years of experience with Python, and experience building scalable Big Data solutions and ETL ecosystems
• Proficiency in SQL, ETL/ELT, and data modeling, with extensive experience in Snowflake and dbt
• Hands-on experience with RDBMS such as MySQL, MS SQL Server (optional), and Postgres
• Familiarity with integration tools like Airflow and Automic, along with a working knowledge of CI/CD pipelines
• Ability to deliver high standards of code quality, system reliability, and performance
• Deep understanding of the modern IaC ecosystem to drive automated infrastructure deployments
• Experience with cloud computing services, preferably AWS, including hands-on experience with services like Glue, Airflow (MWAA), DMS, EKS, and SNS

Benefits

• Healthcare benefits
• 401(k) plan
• Short-term and long-term disability coverage
• Basic life insurance
• Lucrative stock option plan
• Bonus plans