Data Engineering Specialist

Data Engineering Specialist will design, build, and support high-quality engineering products from extensive data sources and multi-cloud environment. The role involves working on exciting data products that support TV, Broadband, Digital Voice, and market-leading technologies like Unbreakable Wi-Fi. The candidate will be part of the Data & AI Enablement Team and will have opportunities to explore new technologies, develop new skills, innovate, and grow as an engineer.

Requirements

• Design, develop, and maintain end-to-end data pipelines using Ab Initio (GDE, PDL, Conduct>IT, Express>IT).
• Build scalable batch and streaming workloads using Apache Spark (PySpark/Scala).
• Develop and orchestrate data ingestion flows using Apache NiFi for real-time and near-real-time use cases.
• Optimize ETL/ELT jobs for scalability, throughput, and resource efficiency.
• Perform bottleneck analysis and tuning for Spark jobs, NiFi processors, and Ab Initio graphs.
• Demos and knowledge transfers to stakeholders around product developments.
• Spread your experience and knowledge to junior engineers.
• Improve automated testing and deployments using CI/CD pipelines.
• Expectation to line manage small team of junior data engineers.
• Continual learning through internal and external training.