Keyrus is looking for a Data Engineer IA to design, develop, and maintain scalable and reliable data pipelines in GCP, supporting Analytics, Machine Learning, and AI initiatives. The ideal candidate has expertise in Python, BigQuery, Jupyter Notebooks, and Vertex AI.
Requirements
- Design, develop, and maintain scalable and reliable data pipelines in GCP
- Build and orchestrate data ingestion, transformation, and processing pipelines using Python, Jupyter Notebooks, and Dataproc
- Work with BigQuery for analysis, transformation, modeling, and optimization of data
- Support the development of AI Generative applications, integrating data with LangChain, Google ADK, and Vertex AI-based solutions
- Manage data, model, and experiment artifacts using Artifact Registry
- Use Google Vector Database for solutions involving embeddings, semantic search, and RAG use cases
- Version code, pipelines, and notebooks using GitLab, following good engineering practices
- Collaborate with multidisciplinary teams in an agile environment, supporting data-oriented architectures
- Contribute to data governance, quality, security, and observability practices
Benefits
- Competitive salary
- Good working conditions
- Opportunities for growth and professional development