The Senior Data Engineer role is a highly rewarding and hands-on position that requires strong expertise in building and managing data pipelines using the Elastic Stack and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security standards and regulations.
Requirements
- UK DV Clearance or the ability obtain it
- 3+ years of experience working as a Data Engineer in secure or regulated environments
- Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization
- Strong experience with Apache NiFi for building and managing complex data flows and integration processes
- Knowledge of security practices for handling sensitive data, including encryption, anonymization, and access control
- Familiarity with data governance, data quality management, and compliance standards in secure environments
- Experience in managing large-scale, real-time data pipelines and ensuring their performance and reliability
- Strong scripting and programming skills in Python, Bash, or other relevant languages
- Working knowledge of cloud platforms (AWS, Azure, GCP) with a focus on data security and infrastructure as code
- Excellent communication skills with the ability to collaborate effectively with cross-functional teams
- Detail-oriented with a focus on ensuring data accuracy, quality, and security
- Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues
Benefits
- Company funded flexible benefits
- Holidays: 25 days plus bank holidays
- Pension: Award winning pension scheme (up to 10% employer contribution)
- Wellbeing: Employee Assistance Programme with access to free mental health support, financial wellbeing support and network groups to demonstrate our ongoing commitment to diversity & inclusion
- Lifestyle: Discounted Gym membership, Cycle to work scheme
- Training: Free access to more than 4000 online courses via Coursera
- Referral Incentive: You can earn a reward for successfully referring a friend or family member
- Bonus: Scheme in place for all employees at management level and below
