Principal Data Engineer

Role Overview

Join our Data Engineering Team as a Principal Data Engineer to build world-class data solutions and applications that power crucial business decisions. You will enable a world-class engineering practice, drive the approach with which we use data, and develop backend systems and data models to serve the needs of insights.

What You Will Do

Own the technical evolution of the data engineering capabilities, establish a deep understanding of how things work in data engineering, and maintain a high bar for operational data quality. Drive complex decisions, architect solutions, and lead a team of data engineers.

Why It Might Be a Fit

We are looking for an open-minded, structured thinker who is passionate about building systems at scale. You will have the opportunity to work with the latest technologies, drive Atlassian's business growth, and improve the product experience.

Requirements

• 12+ years of experience in a Data Engineer role as an individual contributor
• At least 2 years of experience as a tech lead for a Data Engineering team
• Experience with building streaming pipelines with a micro-services architecture for low-latency analytics
• Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)
• Experience building scalable data pipelines using Spark using Airflow scheduler/executor framework or similar scheduling tools
• Experience working in a technical environment with the latest technologies like AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, or Kafka)
• Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team
• Industry experience working with large-scale, high-performance data processing systems (batch and streaming) with a 'Streaming First' mindset

Benefits

• health and wellbeing resources
• paid volunteer days