ING Hubs Poland is hiring a Senior Data Engineer to design, implement, and maintain an on-premises Cloudera Hadoop-based data platform, with a focus on building batch and streaming data pipelines using Apache Nifi and Spark.
Requirements
- Hands-on experience with Hadoop ecosystem and related tools
- Strong proficiency in Confluent Kafka for real-time data streaming
- Expertise in Java/Scala, Python, and Ansible for data engineering and platform development
- Experience in building microservices and event driven architecture
- Proven experience in designing and implementing highly available, scalable, and fault-tolerant data platforms
- Good understanding of CI/CD concepts and Elastic based monitoring solutions
- Knowledge of relational database concepts, design and performance tuning
- Knowledge of data security, access management and risk compliance
- Understanding of data governance practices
Benefits
- Competitive salary range of 13,000 - 28,000 PLN
- Opportunity to work with a wide range of technologies, including big data technologies and public cloud platforms
