Experienced Web Scraping Engineer - Python

We’re a team of 500+ professionals who develop cutting-edge proxy and web data scraping solutions for thousands of the world’s best known businesses. As an Experienced Web Scraping Engineer, you’ll be solving complex challenges and maintaining our own infrastructure with 60PB+ monthly data traffic.

Requirements

• experience working with Python
• understanding of computer science
• version control skills using Git
• knowledge on how to unblock websites for scraping
• ability to use different scraping techniques & open-source tools to build scrapers
• comfortable with using Dev Tools
• network (TLS/SSL) knowledge
• worked with browser automations
• knowledge of asynchronous programming
• web development knowledge
• ability to use CSS Selectors / XPaths for parsing
• experience working with Go & C++
• worked on browser source code
• knowledge of any front-end framework
• experience working with Pydantic, FastAPI, SQLAlchemy
• experience working with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana and monitoring tools like Grafana, Prometheus
• experience with machine learning that is scraping domain-specific
• experience in building scalable systems

Benefits

• generous salary
• professional development opportunities