Java Big Data Engineer

Role Overview

We are looking for an experienced Java Big Data Engineer to join a dynamic team in the financial services sector. This is a hybrid role based in Toronto, requiring 4 days onsite per week. You will work on large-scale data processing pipelines, real-time streaming solutions, and high-performance Java applications.

What You Will Do

Design, develop, and maintain scalable big data pipelines using Java and Spark, work with Hadoop ecosystems, implement real-time streaming solutions, optimize and tune performance of big data applications, and troubleshoot and resolve production issues.

Why It Might Be a Fit

You will collaborate with data scientists, analysts, and business stakeholders, ensure data quality, governance, and security standards are met, and work with cloud-based data platforms.

Requirements

• Strong core Java (8+) development experience
• Hands-on experience with Apache Spark (batch and streaming)
• Proficiency in Hadoop ecosystem (HDFS, Hive, YARN)
• Experience with Kafka for real-time data streaming
• Strong SQL skills and experience with relational and NoSQL databases
• Experience with Unix/Linux environments and shell scripting
• Familiarity with version control (Git) and CI/CD pipelines