At Kpler, we are dedicated to helping our clients navigate complex markets with ease. We are hiring a Senior Data Engineer to own the design, delivery, and reliability of platform capabilities that ingest and deliver data at scale. The role involves leading complex, high-impact initiatives, shaping engineering best practices, and partnering closely with other teams to improve developer experience and platform adoption.
Requirements
- Design and implement Snowflake ingestion pipelines in Java, sourcing data from upstream systems and delivering high-quality solutions for high-impact, ambiguous, and complex problem spaces.
- Own the reliability and operational excellence of ingestion services, including monitoring and observability, stability, performance, scalability, and on-call readiness, while making sound engineering trade-offs aligned with business needs.
- Maintain and evolve existing pipelines by identifying bottlenecks, reducing failure modes, and proactively addressing issues before they impact users or downstream systems.
- Lead technical design for complex initiatives, driving end-to-end architecture and implementation while coordinating across teams and stakeholders.
- Drive continuous improvement to developer experience for data ingestion by contributing to platform standards, improving usability and documentation, and partnering with other teams to enable adoption and consistent best practices.
- Refactor and modernise complex systems pragmatically, balancing technical debt against delivery timelines and proposing scope changes as priorities shift.
- Lead and debug production issues and major incidents under pressure, ensuring rapid mitigation, clear communication, and follow-through on corrective actions.
- Contribute to the platform roadmap and cross-organisational technical direction by participating in architecture forums and broader engineering initiatives that strengthen the discipline.
- Collaborate on platform-adjacent projects as needed, including client-facing data access and delivery solutions.
- Partner on data governance and risk communication, working effectively with functions such as compliance and clearly articulating technical risk and trade-offs to non-technical stakeholders.
Benefits
- Good compensation and benefits
- Flexible working hours
- Collaborative and dynamic work environment
- Professional development opportunities
- Diverse and inclusive workplace
