Data Engineer

Role Overview

Collaborate with a dynamic team to develop and maintain Python-based applications, design and implement software solutions, and contribute to the entire software development lifecycle.

What You Will Do

Write clean, scalable, and well-documented code, optimize code for maximum efficiency and maintainability, troubleshoot, debug, and address software defects and issues.

Why It Might Be a Fit

Strong problem-solving and algorithmic thinking, ability to work collaboratively in a team-oriented environment, and exposure to DevOps practices and tools.

Requirements

• Strong proficiency in Python and PySpark
• Experience in writing SQL queries & scripting
• Experience in creating ETL flows and data orchestration
• Experience in working on files: CSV, Excel, Parquet
• Good to have working experience with Databricks, and Spark Server
• Good to have working experience with PowerBi, Tableau
• Knowledge of database systems: MySQL, PostgreSQL,OracleDB, MSSQL
• Familiarity with version control systems, particularly Git
• Exposure to DevOps practices and tools
• Exposure to cloud services, particularly AWS
• Experience in managing Apache Airflow