We're looking for a Senior Data Engineer with knowledge of Databricks data architecture to work in the Vila Olimpia region (São Paulo/SP). The role involves collaborating with other analysts to provide actionable insights, monitoring and optimizing data system performance, and creating data entry portals, dashboards, and reports.
Requirements
- Experience with Cloud – Azure
- Knowledge of Databricks
- Knowledge of Spark
- Knowledge of SQL and data structure for user consumption
- Programming skills in Python
- Knowledge of Kafka for event-oriented architectures
- Knowledge of Airflow
- Knowledge of MongoDB
- Understanding, concept, and proposal of Data Governance and Data Domain
- Ability to learn and follow work patterns (DevOps)
- Ability to identify problems and promote their resolution
- Acting with JIRA, Confluence