Senior Azure Data Engineer
Agilisium ConsultingChennai, Tamil Nadu, India
Posted September 8, 2025
Full Time
About the Company
Agilisium Consulting is a leading provider of autonomous, AI‑driven solutions for the Life Sciences sector, specializing in end‑to‑end data engineering, cloud migration, and advanced analytics. The company designs and co‑creates scalable, AI‑engineered business processes that streamline operations for pharmaceutical and biotech organizations, leveraging technologies such as AWS, SnapLogic, and generative AI. Its portfolio includes data lakehouse architecture, embedded analytics, intelligent bots (Alexa, Lex), and data observability tools that transform operational workflows into autonomous, data‑centric systems. By combining deep life‑sciences domain expertise with cutting‑edge data science and DevOps practices, Agilisium delivers end‑to‑end solutions that accelerate innovation and reduce time‑to‑market for its clients.
Job Description
We are looking for a Senior Azure Data Engineer with expertise in PySpark, Databricks, and SQL to build scalable data pipelines and integrate complex biomedical datasets.
Requirements
- Design and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics, research, and operational sources.
- Optimize performance and scalability of data flows using Apache Spark, Databricks, or AWS Glue.
- Collaborate with domain experts in genomics, clinical trials, and lab science to implement robust data solutions.
- Develop and maintain data models, schemas, and governance practices for structured and unstructured biomedical data.
- Implement data quality checks, lineage, logging, and alerts to ensure reliability and reproducibility.
- Work with cloud infrastructure teams to deploy pipelines on AWS, GCP, or Azure.
- Contribute to data lake/warehouse solutions (Snowflake, Redshift, Synapse).
