We are seeking a highly skilled AWS Data Engineer to enhance our data and analytics environment. The successful candidate will play a pivotal role in designing, developing, and managing data solutions that leverage cloud technologies and big data frameworks.
Requirements
- Build and maintain large-scale ETL pipelines using AWS Glue, Lambda, and Step Functions.
- Design and manage data lakes on Amazon S3, implementing robust schema management and lifecycle policies.
- Work with Apache Iceberg and Parquet formats to support efficient and scalable data storage.
- Develop distributed data processing workflows using PySpark.
- Implement secure, governed data environments using AWS Lake Formation.
- Build and maintain integrations using AWS API Gateway and data exchange APIs.
- Automate infrastructure provisioning using Terraform or CDK for Terraform (CDKTF).
- Develop CI/CD pipelines and containerized solutions within modern DevOps practices.
- Implement logging, observability, and monitoring solutions to maintain reliable data workflows.
- Perform root cause analysis and optimize data processing for improved performance and quality.
- Collaborate with business intelligence teams and analysts to support reporting and analytics needs.
- Work in cross-functional, Agile teams and actively participate in sprint ceremonies, backlog refinement, and planning.
- Provide data-driven insights and recommendations that support business decision-making.
Benefits
- Generous Paid Time Off
- 401k Matching
- Retirement Plan
- Relocation Assistance
