As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and architectures.
Requirements
- Design, construct, install, and maintain large-scale processing systems and other infrastructure.
- Develop and maintain data pipelines using tools such as Apache Airflow, Spark, or similar.
- Optimize data systems for performance, reliability, scalability, and quality.
- Implement data integration processes from multiple sources (APIs, internal databases, third-party data).
- Ensure data is secure, governed, and meets compliance standards.
- Collaborate with analytics and product teams to support their data needs.
- Monitor, troubleshoot, and optimize data workflows and data storage solutions