Craft is looking for a Senior Data Engineer to join their DISCoE team, responsible for defining and implementing data storage standards, interacting with data, and creating tools for data operations. The role involves building and optimizing data pipelines, extracting and analyzing datasets, and applying machine learning techniques.
Requirements
- 2+ years of experience in Data Engineering
- 2+ years of experience with Python
- Experience in developing, maintaining, and ensuring the reliability, scalability, fault tolerance and observability of data pipelines in a production environment
- Strong knowledge of SDLC and solid software engineering practices
- Knowledge of and experience with Amazon Web Services (AWS) and Databricks
- Familiarity with infrastructure-as-code approach
- Self-starter, independent, likes to take initiative
- Have fundamental knowledge of data engineering techniques: ETL/ELT, batch and streaming, DWH, Data Lakes, distributed processing
- Familiarity with at least some technologies in our current tech stack: Python, PySpark, Pandas, SQL (PostgreSQL), Airflow, Docker, Databricks & AWS (S3, Batch, Athena, RDS, DynamoDB, Glue, ECS), CircleCI, GitHub, Terraform
Benefits
- Option to work as a B2B contractor or full-time employee
- Competitive salary at a well-funded, fast-growing startup
- PTO days so you can take the time you need to refresh!
- Full-time employees: 28 PTO days allotted + paid public holidays
- B2B contractors: 15 PTO days allotted + paid public holidays
- 100% remote work (or hybrid if you prefer! We have coworking space in center of Warsaw.)