We're seeking a Senior Data Engineer to design, build, and operate large-scale, data-intensive platforms in the cloud. You'll be responsible for developing reliable data pipelines, scalable data processing systems, and high-availability architectures that support analytics, machine learning, and data science use cases.
Requirements
- Bachelor's or Master's in a related field, or commensurate experience
- 5+ years in Computer Science, with a proven track record of successful projects.
- 5+ years of experience operating and deploying solutions using AWS Service including S3, EMR, SQS, SNS, Lambdas, Athena, Glue, Kinesis, and MSK.
- 5+ years of experience with one or more of the following programming languages: Python, Scala, or Java
- 5+ years of experience with SQL.
- 5+ years of experience with big data technologies such as Cassandra, Spark, Hadoop, Parquet, Redash, etc.
- Advanced proficiency in building data integrations using both API and file-based protocols.
- Advanced proficiency with test-driven development and unit testing.
- Experience with Git Version Control or similar
- Experience with CI/CD pipeline patterns and best practices
- Proficiency with alerting and monitoring tools like Grafana
- Demonstrated ability to learn new technologies and languages.
- Able to put together process documentation concisely and clearly.
- Excellent written and verbal communication skills.
- Able to work closely and effectively with peer developers and work on several active projects simultaneously, including leading small projects.
- Solid experience implementing high-availability, scalable cloud solutions
- Strong understanding of data structures and algorithms
- Solid knowledge of functional programming languages and techniques, and object-oriented programming languages and techniques
- Solid knowledge of concurrency and concurrent programming techniques and distributed computing techniques
- Knowledge and understanding of operating with data in large scale, including Machine Learning and Data Science concepts
Benefits
- Flexible Time Off program
- Hybrid work model
- Variety of medical insurance options
- Competitive 401K match
- National health, dental, and vision plans
- Progressive family plan benefits