We are looking for a Senior Data Engineer with strong expertise in PySpark, Python, and Big Data technologies to support enterprise-scale Data Engineering initiatives.
Requirements
- Strong hands-on experience with Python and PySpark development
- Deep expertise in Apache Spark including Spark optimization and performance tuning techniques
- Strong experience with Big Data technologies and distributed processing frameworks
- Hands-on experience with Hadoop ecosystem technologies
- Strong proficiency in SQL and complex data transformation logic
- Experience building and maintaining machine learning data pipelines and feature engineering workflows
- Experience with Git and version control best practices