Senior Data Engineer

Role Overview

Design premier data architecture and solutions that drive strategic decision-making. Collaborate with business stakeholders to translate operational needs into technical requirements and spearhead initiatives to improve overall system efficiency.

What You Will Do

Partner across engineering organizations to execute high-impact initiatives, mentor junior engineers, and collaborate with leadership to understand business data requirements.

Why It Might Be a Fit

Required strengths include technical expertise, leadership, and collaboration. Growth/autonomy/impact: mentor junior engineers, spearhead initiatives. Notable constraints: must have 6+ years of experience as a Data Engineer or in a similar role.

Requirements

• BE in Computer Science or equivalent
• 6+ years of professional experience as a Data Engineer or in a similar role
• Experience building scalable data pipelines in Spark using Airflow scheduler/executor framework or similar scheduling tools
• Experience with Databricks and its APIs
• Experience with modern databases (Redshift, Dynamo DB, Mongo DB, Postgres or similar) and data lakes
• Proficient in one or more programming languages such as Python/Scala and rock-solid SQL skills
• Champion automated builds and deployments using CICD tools like Bitbucket, Git
• Experience working with large-scale, high-performance data processing systems (batch and streaming)
• Experience working for SAAS companies
• Experience with Machine Learning
• Committed code to open source projects
• Experience building self-service tooling and platforms

Benefits

• health and wellbeing resources
• paid volunteer days