Lead, Big Data Analytics & Engineering job description summary - Lead, Data Engineering role focuses on data engineering and data unification across diverse enterprise data assets, enabling a single, trusted, and scalable view of data from multiple internal and external sources.
Requirements
- Strong proficiency in Python, including Pandas, NumPy, PySpark, and experience with Impala.
- Hands on experience performing data extraction, analysis, and processing on Hadoop based platforms.
- Strong SQL skills and experience working with large scale relational and distributed data stores.
- Experience with enterprise data platforms and business intelligence ecosystems.
- Hands on experience with ETL / ELT and data integration tools such as Airflow, Apache NiFi, Azure Data Factory, Pentaho, or Talend.
- Experience with data modeling, querying, data mining, and reporting over large volumes of granular data.
- Exposure to machine learning concepts and analytical techniques used in advanced data solutions.
- 8+ years of experience in data engineering, big data analytics, or enterprise data platforms, with at least 2+ years in a technical leadership or lead role.
- Experience working with cloud-based data platforms (Azure, AWS, or GCP), including data lakes, distributed compute, and storage services.
- Experience implementing CI/CD pipelines and DevOps practices for data engineering workflows.
Benefits
- Retirement Plan
- Visa Sponsorship