We are seeking a highly skilled Senior Data Engineer to design, build, and support enterprise data engineering and analytics solutions across both on-premises and cloud environments.
Requirements
- Design, develop, test, deploy, and support scalable data engineering and analytics solutions across on-premises and cloud environments.
- Create functional and technical designs for data pipelines, data models, AI/ML integration, and analytics products.
- Implement and optimize batch and real-time data processing frameworks to support operational and analytical use cases.
- Develop and maintain data models using varied schema types and integrating diverse source systems.
- Ensure data quality, lineage, governance, and reliability using industry-standard tools and frameworks.
- Build big data solutions and pipelines leveraging Hadoop ecosystem tools such as Hadoop, Hive, and Spark.
- Design and develop statistical models and AI/ML solutions using R, Python, and cloud-native machine learning tools.
- Develop and optimize ETL/ELT pipelines using on-premises tools such as MSBI (SSIS/SSAS), Informatica, Oracle Golden Gate, SQL Server, and Oracle.
- Create cloud-based data engineering solutions using Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Synapse, and related Azure services.
- Implement secure designs using Azure Key Vault and other cloud governance tools.
- Build and maintain APIs and web services for data sourcing, enrichment, and delivery.
- Apply Agile methodology and DevOps best practices, including CI/CD automation and containerization.
- Collaborate closely with data architects, analysts, data scientists, and business partners to meet enterprise data needs.
Benefits
- Paid Time Off
- 401k Matching
- Retirement Plan
