As a Data Engineer in the Data Collection Team, you will leverage various methods to transform raw data into reliable and scalable data systems. You will focus on improving efficiency by aligning data architecture with business goals, while being hands-on in building data collection infrastructure.
Requirements
- Prior experience in large-scale public data collection from the web using open APIs and other tools
- Strong understanding of relevant terms of service, guidelines, and technical considerations governing such data collection
- Familiarity with multiple programming languages
- Basic understanding of machine learning methods
- Hands-on experience with SQL and database design
- Previous experience as a Data Engineer or in a similar role
- Strong technical knowledge of web data collection architectures, including proxy and header management
- Excellent numerical and analytical skills
- Willingness to learn and adapt to new tools and technologies
- Proactive, curious, and highly tenacious, with a strong drive to grow and stay ahead of industry trends
- Comfortable navigating a fast-paced, ambiguous environment with a high degree of independence
Benefits
- Generous Paid Time Off
- 401k Matching
- Tuition Reimbursement
