Lead AWS Software Data Engineer

Role Overview

Join us at FTSE Russell! We’re establishing a team of engineers passionate about data, software craftsmanship, and substantial impact. As a Lead Software Data Engineer, you’ll help power the indices trusted by financial institutions worldwide. You’ll work in a modern AWS environment, build robust pipelines, and collaborate closely with product and business teams to deliver reliable, high-quality data solutions.

What You Will Do

Designing and developing scalable, testable data pipelines using Python and Apache Spark, orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3, applying modern software engineering practices: version control, CI/CD, modular design, and automated testing.

Why It Might Be a Fit

We care about code quality, ownership, and helping each other grow. If you’re excited about building systems that matter, we’d love to meet you!

Requirements

• Writes clean, maintainable, testable, extensible Python code (ideally with type hints, linters, and tests like pytest)
• Understands data engineering basics: batch processing, schema evolution, and building ETL pipelines
• Has experience with or is eager to learn Apache Spark for large-scale data processing
• Is familiar with the AWS data stack (e.g. S3, Glue, Lambda, EMR)
• Strong experience in relational databases (e.g. Aurora PostgreSQL)
• Enjoys learning the business context and working closely with stakeholders
• Works well in Agile teams and values collaboration over solo heroics

Benefits

• healthcare
• retirement planning
• paid volunteering days
• wellbeing initiatives