Data Engineer (Databricks)
PradeepIT Consulting Services Pvt LtdBengaluru, Karnataka, India
Posted January 5, 2026
Full Time
About the Company
PradeepIT Consulting Services Pvt Ltd (PGC Digital) delivers end‑to‑end digital transformation and IT staffing solutions for enterprise clients worldwide. Leveraging partnerships with SAP, Microsoft, Salesforce and ServiceNow, the company offers on‑demand staff augmentation, AI‑enabled talent acquisition, greenfield and migration projects, and managed support services that are certified to CMMI Level 3, ISO 9001 and ISO 27001 standards. Its people‑first culture, recognized as a Great Place to Work and India’s Best Workplace for Women, fuels a collaborative approach that positions PGC Digital as a trusted extension of its customers’ teams. With a global delivery network spanning India, Canada, the U.S., and a Singapore regional hub, the firm is scaling toward a public listing in 2026 to accelerate growth and deliver long‑term value.
Job Description
Design and build data pipelines using Spark-SQL and PySpark in Azure Databricks, build and maintain a Lakehouse architecture in ADLS / Databricks, and perform data preparation tasks including data cleaning and type conversion.
Requirements
- Design and build data pipelines using Spark-SQL and PySpark in Azure Databricks
- Design and build ETL pipelines using ADF
- Build and maintain a Lakehouse architecture in ADLS / Databricks
- Perform data preparation tasks including data cleaning, normalization, deduplication, type conversion etc.
- Work with DevOps team to deploy solutions in production environments
- Control data processes and take corrective action when errors are identified
- Participate as a full member of the global Analytics team
- Collaborate with Data Science and Business Intelligence colleagues
- Lead projects and participate in projects led by other team members
- Apply change management tools