Python Data Engineer

ShyftLabs is a rapidly growing data product company delivering digital solutions for Fortune 500 companies. They are seeking a skilled Python Data Engineer to design, develop, and maintain scalable data solutions. The role involves translating business requirements into reliable data systems, optimizing performance, and ensuring data quality.

Requirements

• Develop and maintain data pipelines and ETL/ELT processes using Python
• Design and implement scalable, high-performance applications
• Work collaboratively with cross-functional teams to define requirements
• Develop and manage near real-time data streaming solutions using PubSub or Beam
• Monitor and troubleshoot production systems to ensure reliability and Performance
• Proficiency with SQL and database concepts
• Experience with data processing frameworks (e.g., Pandas)
• Understanding of software design patterns and architectural principles
• Write clean, well-documented, and maintainable code
• Experience with unit testing and test automation
• Experience working with any cloud provider (GCP is preferred)
• Experience with CI/CD pipelines and Infrastructure as code
• Experience with Containerization technologies like Docker or Kubernetes

Benefits

• Competitive salary
• Strong insurance package
• Growth of employees