Senior Data Engineer with Python (IR-491)

Senior Data Engineer with Python (IR-491) at Intellectsoft, Bengaluru, India, hybrid job. Work on AI-powered platform for data analysis and insights, use Apache Spark and SQL. Collaborate with data science team and develop new features.

Requirements

• 4+ years of professional experience
• 2+ years of data engineering with Apache Spark and SQL
• Proficiency in Python for data processing and automation
• Knowledge of PySpark, distributed computing, analytical databases, and big data technologies
• Expertise in designing and managing ETL pipelines and distributed data processing frameworks
• Strong knowledge of database systems, data modeling, and analytical databases
• Hands-on experience with workflow orchestration tools such as Apache Airflow
• Familiarity with cloud platforms like AWS, GCP, or Azure
• Solid understanding of software development lifecycles, including coding standards, version control, and testing

Benefits

• Employment-based cooperation
• Awesome projects with an impact
• Comprehensive insurance for you and your family
• Paid PTO policy
• Tech equipment provided
• Udemy courses, workshops, trainings & expert knowledge-sharing
• Flexible hours & work setup