Data Integration Engineer

The Integration Engineer leads the transformation of our legacy point-to-point system integrations into a modern, scalable, and event-driven ecosystem using Confluent Kafka and micro services architecture.

Requirements

• Design and implement scalable and reliable integration solutions using Confluent Kafka with pub/sub messaging pattern and related technologies.
• Collaborate with cross-functional teams to define integration requirements, standards, and best practices.
• Monitor, optimize, and troubleshoot Kafka clusters, producers, consumers, and schema registry configurations.
• Work with DevOps and Cloud teams to deploy integration solutions using CI/CD pipelines and containerized environments.
• Develop and maintain APIs and integration services using modern programming languages (e.g., Java, Python, Node.js).
• Responsible for development, testing, deployments and implementing integration processes in various environments
• Experience on Azure DevOps to build the solutions and implement CI/CD change release strategy
• Work with Operations teams to minimize the production issues/bug fixes to improve productivity
• Develop and maintain processes which help minimize manual efforts and improve operational efficiencies’ in integrations space to contribute to continuous improvement
• Contribute strategically to consolidate and leverage existing applications to streamline business processes and reduce overhead
• Communicate effectively with senior management and all users of information services and system
• Oversight and accountability for all integration flows and data quality ensuring SLAs are met
• Perform other related duties and activities as required.

Benefits

• Generous Paid Time Off
• 401k Matching
• Tuition Reimbursement