We are looking for a Data Engineer with 5+ years of experience in Data Engineering or developing Data Platforms. The role requires extensive practical experience with AWS, AWS Glue, AWS S3, and AWS Lambda, as well as proficiency with Data Workflow Orchestration tools like Apache Airflow or AWS Step Functions.
Requirements
- 5+ years of experience in Data Engineering or developing Data Platforms
- Extensive practical experience with AWS, AWS Glue, AWS S3, and AWS Lambda
- Proficiency with Data Workflow Orchestration tools like Apache Airflow or AWS Step Functions
- Proven experience in migrating data from various data warehouse technologies
- Skilled in migrating data from RDBMS systems to AWS S3 or AWS Redshift
- Strong command of Python and SQL for creating scalable data pipelines
- Comprehensive understanding of ETL/ELT principles, data partitioning, and distributed data processing
- Experience using version control systems such as GitLab or Bitbucket
- Excellent debugging skills, analytical thinking