Particle41 is seeking a talented and versatile Data Engineer to join our innovative team. As a Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines and infrastructure to support our clients' data needs.
Requirements
- Design, implement, and optimize Elasticsearch clusters for high-performance querying and data retrieval.
- Build and manage Elasticsearch indexes, ensuring data is stored, indexed, and queried efficiently.
- Build and optimize data storage solutions like data lakes and warehouses.
- Integrate structured and unstructured data from various internal and external systems to create a unified view for analysis.
- Ensure data accuracy, consistency, and completeness through rigorous validation, cleansing, and transformation processes.
- Maintain comprehensive documentation for data processes, tools, and systems while promoting best practices for efficient workflows.
- Collaborate with product managers, and other stakeholders to gather requirements and translate them into technical solutions.
- Participate in requirement analysis sessions to understand business needs and user requirements.
- Provide technical insights and recommendations during the requirements-gathering process.
- Participate in Agile development processes, including sprint planning, daily stand-ups, and sprint reviews.
- Work closely with Agile teams to deliver software solutions on time and within scope.
- Adapt to changing priorities and requirements in a fast-paced Agile environment.
- Conduct thorough testing and debugging to ensure the reliability, security, and performance of applications.
- Write unit tests and validate the functionality of developed features and individual elements.
- Writing integration tests to ensure different elements within a given application function as intended and meet desired requirements.
- Identify and resolve software defects, code smells, and performance bottlenecks.
- Stay updated with the latest technologies and trends in full-stack development.
- Propose innovative solutions to improve the performance, security, scalability, and maintainability of applications.
- Continuously seek opportunities to optimize and refactor existing codebase for better efficiency.
- Stay up-to-date with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Collaborate effectively with cross-functional teams, including testers, and product managers.
- Foster a collaborative and inclusive work environment where ideas are shared and valued.
Benefits
- Generous Paid Time Off
- 401k Matching
- Retirement Plan
- Visa Sponsorship
- Four Day Work Week
- Generous Parental Leave
- Tuition Reimbursement
- Relocation Assistance
