Datacom is seeking a Principal Engineer - Data to lead the design and development of a modern, composable data platform on open standards. The role will involve building real-time streaming data pipelines, creating data infrastructure for AI and agentic capabilities, and implementing fine-grained authorisation across the data layer.
Requirements
- Deep experience with modern data engineering — data lakes or lakehouses, columnar storage formats, and layered transformation architectures.
- Strong SQL skills and hands-on experience with analytical query engines.
- Experience building and operating real-time or near-real-time data pipelines using event streaming platforms.
- Familiarity with data transformation frameworks and an understanding of data contracts and schema governance.
- Proficiency with cloud data infrastructure (Azure preferred) — object storage, container orchestration, secrets management, and monitoring.
- Strong understanding of multi-tenant data security — tenant isolation, role-based access control, PII handling, and data sovereignty requirements.
- Experience designing data platforms that serve both operational and analytical workloads — you know the difference between ELT and ETL and when each pattern applies.
- Proficiency in Python and/or TypeScript for pipeline development and automation.
- Track record of making sound architectural decisions in ambiguous, greenfield environments.
- Excellent communication skills — you can translate complex data architecture decisions into language that product, security, and leadership stakeholders understand.
Benefits
- Flexible working hours
- Professional development courses
- Remote working
- Social events
- Chill-out spaces
