We are seeking an experienced Senior Data Engineer to lead the development and optimization of data infrastructure supporting our Agentic AI initiatives. The role involves collaborating with ML engineers, AI scientists, and product managers to architect, implement, and maintain robust data pipelines powering autonomous AI agents.
Requirements
- Design, develop, and maintain scalable data pipelines and ETL processes supporting AI research and development.
- Design and maintain scalable data models for analytics, ML training, and agent workflows.
- Implement data governance and security measures to protect sensitive information.
- Establish observability, lineage tracking, and monitoring frameworks to detect anomalies, freshness issues, and operational failures.
- Implement data partitioning, indexing, and storage optimization techniques for large-scale AI datasets.
- Monitor and troubleshoot data pipeline issues to ensure continuity and reliability.
- Stay current with emerging data engineering and AI technologies.
- Drive data platform reliability, scalability, and cost optimization across cloud-based infrastructure.
Benefits
- Comprehensive salary and benefits package
- Opportunities for professional growth and development
- Collaborative and innovative work environment
- Flexible working hours and remote work options
- Professional mentorship and coaching