As a Senior/Expert ML/Data Engineer, you will be at the forefront of our data science and machine learning initiatives, actively contributing to the evolution of our AI-powered solutions. You will be instrumental in designing, building, and maintaining our cutting-edge data infrastructure and machine learning pipelines, with a growing focus on leveraging the power of Large Language Models (LLMs) and other emerging AI technologies.
Requirements
- 5+ years of experience in building and maintaining complex data pipelines and data warehousing solutions in a production environment.
- Expert proficiency in data engineering tools and technologies, including Spark (PySpark and/or Scala), Python, SQL, and various ETL/ELT tools.
- Deep understanding of data modelling techniques (e.g., star schema, dimensional modelling) and data warehousing concepts.
- Strong knowledge of data governance, data quality principles, and data security best practices, with an awareness of the specific security and ethical considerations related to AI models.
- Significant experience with data integration, data cleansing, and data transformation processes on large datasets, including data preparation for machine learning and LLMS.
- Familiarity with data profiling and data lineage tools.
- Excellent ability to identify, diagnose, and resolve data issues, performance bottlenecks, and data quality problems effectively, including those encountered when working with large AI models.
- Strong analytical and problem-solving skills to analyse complex data sets and translate them into actionable technical solutions, with an aptitude for understanding the nuances of AI model performance.
- Excellent written and verbal communication skills to effectively convey technical concepts to both technical and non-technical audiences, including discussions around AI model capabilities and limitations.
- Strong teamwork and collaboration skills with the ability to build effective working relationships across teams, especially when integrating new AI technologies.
- A proactive and solution-oriented approach with a strong drive to learn and implement new technologies, particularly within the rapidly evolving fields of AI and LLMS.
- Meticulous attention to detail to ensure data accuracy and integrity, which is critical for the reliability of AI models.
- Proven ability to write clear and concise technical documentation, including documentation for AI model development and deployment.
Benefits
- Innovative Projects: Work on cutting-edge projects that push the boundaries of AI, machine learning, and data engineering, including the exciting application of Large Language Models.
- Dynamic Technology Environment: Be part of a team that actively explores, tests, and integrates the latest technological advancements, including the newest developments in AI and LLMs.
- Innovation Hub: Collaborate with a team of experts and leverage the latest technologies to drive innovation in the realm of AI and data.
- Collaborative Culture: A supportive and team-focused environment where your expertise and contributions, especially in the area of new AI technologies, are highly valued.
- Growth Opportunities: Opportunities for professional development and growth within a rapidly expanding company at the forefront of AI innovation.
- Impactful Work: Play a key role in shaping the future of our product and influencing critical business decisions for world-leading companies through the application of advanced AI technologies.
