Senior Data Engineer with Python (IR-491) at Intellectsoft, Bengaluru, India, hybrid job. Work on AI-powered platform for data analysis and insights, use Apache Spark and SQL. Collaborate with data science team and develop new features.
Requirements
- 4+ years of professional experience
- 2+ years of data engineering with Apache Spark and SQL
- Proficiency in Python for data processing and automation
- Knowledge of PySpark, distributed computing, analytical databases, and big data technologies
- Expertise in designing and managing ETL pipelines and distributed data processing frameworks
- Strong knowledge of database systems, data modeling, and analytical databases
- Hands-on experience with workflow orchestration tools such as Apache Airflow
- Familiarity with cloud platforms like AWS, GCP, or Azure
- Solid understanding of software development lifecycles, including coding standards, version control, and testing
Benefits
- Employment-based cooperation
- Awesome projects with an impact
- Comprehensive insurance for you and your family
- Paid PTO policy
- Tech equipment provided
- Udemy courses, workshops, trainings & expert knowledge-sharing
- Flexible hours & work setup