Data Engineer

Particle41 is seeking a talented and versatile Data Engineer to join our innovative team. As a Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines and infrastructure to support our clients' data needs.

Requirements

• Design, develop, and maintain scalable ETL (Extract, Transform, Load) pipelines to process large volumes of data from diverse sources.
• Build and optimize data storage solutions, such as data lakes and data warehouses, to ensure efficient data retrieval and processing.
• Integrate structured and unstructured data from various internal and external systems to create a unified view for analysis.
• Ensure data accuracy, consistency, and completeness through rigorous validation, cleansing, and transformation processes.
• Maintain comprehensive documentation for data processes, tools, and systems while promoting best practices for efficient workflows.
• Collaborate with product managers, and other stakeholders to gather requirements and translate them into technical solutions.
• Participate in Agile development processes, including sprint planning, daily stand-ups, and sprint reviews.
• Conduct thorough testing and debugging to ensure the reliability, security, and performance of applications.
• Stay updated with the latest technologies and trends in full-stack development.
• Propose innovative solutions to improve the performance, security, scalability, and maintainability of applications.
• Collaborate effectively with cross-functional teams, including testers, and product managers.