Data Engineer - GCP

Data Engineer role for GCP. Helping development efforts in ingesting and transforming data from various sources. Build distributed, reliable and scalable data pipelines using Google Cloud Platform (GCP) data services. Designing and implementing data ingestion patterns to support batch, streaming and API interface.

Requirements

• 2+ years of experience in data engineering, performance optimization for large OLTP applications
• Knowledge of Hadoop HDFS, Hive, Pig, Flume and Sqoop.
• Knowledge with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc.
• Knowledge with Google Cloud Platform Databases (SQL, Spanner, PostgreSQL)
• Good knowledge of the concepts of Hadoop.
• Knowledge working with relational/NoSQL databases
• Knowledge with data streaming and technologies such as Kafka, Spark-streaming etc.
• Knowledge with Infrastructure as Code (IaC) practices and frameworks like Terraform
• Knowledge of Java microservices and Spring Boot
• Strong architecture knowledge with experience in providing technical solutions for cloud infrastructure.
• Working knowledge of developing and scaling JAVA REST services, using frameworks such as Spring
• Good communication and problem-solving skills. Ability to effectively convey ideas to business and technical teams

Benefits

• Upskilling through online courses, cross-functional development opportunities, and tuition assistance.
• Competitive Rewards program including bonus, flexible vacation, personal, sick days and benefits will start on day one.
• Dynamic Ecosystem - Free tea & coffee, universal washrooms, and lots of space for team collaboration.