Lead Data Engineer - AWS

Valleysoft is seeking a highly-skilled Lead Data Engineer specializing in AWS to join our team. In this role, you will lead the design and implementation of cutting-edge data solutions, unlocking the potential of big data and machine learning for our clients.

Requirements

• Lead design and implementation of batch and real-time data pipelines on AWS
• Architect and implement ETL/ELT solutions using AWS Glue, Spark on EMR, and other AWS-native services
• Lead workflow orchestration using Apache Airflow (MWAA)
• Architect serverless data processing solutions with AWS Lambda
• Design enterprise-grade data warehousing solutions using Amazon Redshift
• Develop and enforce data storage strategies using Amazon S3 and DynamoDB
• Implement and govern data cataloging, governance, and access control using AWS DataZone
• Establish monitoring, logging, and observability using Amazon CloudWatch
• Drive performance optimization, scalability, and cost efficiency
• Troubleshoot complex data processing and infrastructure issues
• Collaborate with cross-functional teams including Analytics, BI, Data Science, and Business teams
• Provide technical leadership, conduct code reviews, and mentor junior engineers
• Ensure adherence to security, compliance, and data governance standards
• Participate in architecture discussions and contribute to long-term data strategy

Benefits

• Private Health Insurance
• Training & Development