The Data Engineer, Senior Specialist is responsible for designing, developing and optimizing data pipelines and architectures to support scalable and efficient data processing.
Requirements
- Develop and maintain efficient ETL pipelines that ingest, process and transform large datasets from diverse sources.
- Build and manage data storage solutions using relational and non-relational databases, ensuring high availability, performance and scalability.
- Work with APIs, third-party data sources and internal databases to create unified datasets that provide actionable insights for business stakeholders.
- Partner with business intelligence analysts, data scientists and software engineers to design and implement data-driven solutions that meet business requirements.
- Design optimized data schemas and structures that support analytical workloads and improve query performance.
- Leverage orchestration tools like Apache Airflow or Prefect to automate ETL workflows and improve operational efficiency.
- Provide technical guidance, review code and promote best practices within the data engineering team.
