As a seasoned Staff Software Development Engineer in Data Platform team, you will be at the forefront of designing, building, and optimizing the critical data infrastructure that handles hundreds of millions of requests per minute for our ingestion services, processes billions of events daily from Kafka, and manages petabytes of data stored in S3.
Requirements
- 8+ years of progressive professional experience in data engineering
- Experience working with data systems that handle hundreds of millions of events/requests per minute
- Strong proficiency in at least one major programming language such as Python, Java, Scala, or Go
- Distributed data processing frameworks like Apache Spark, Apache Flink, or equivalent technologies
- AI/ML data experience
- Extensive experience with high-throughput messaging queues and stream processing platforms
- Hands-on expertise with at least one major cloud platform (AWS, GCP, or Azure) and their data-related services
- Strong understanding and hands-on experience with modern data warehousing concepts and data lake architectures
- Expertise in building, optimizing, and orchestrating complex ETL/ELT pipelines
- Strong SQL skills and experience with both relational and NoSQL databases
- Advanced data modeling skills for large, complex datasets
- Exceptional analytical and problem-solving abilities
- Excellent communication, collaboration, and interpersonal skills