Senior Data Engineer

b_labs is the transformation and digitization arm of B.TECH, on a mission to change the industry as we know it. We spearhead tech innovation at B.TECH, an organization that has been a cornerstone of the Egyptian retail industry.

Requirements

• Design, develop, and maintain large-scale, reliable data pipelines using Python, SQL, and big data technologies such as Apache Spark and Kafka.
• Build and optimize ETL/ELT processes for data transformation, loading, and integration from multiple sources.
• Develop and maintain data storage solutions using both relational and NoSQL databases, including SQL Server, PostgreSQL, MySQL, and MongoDB.
• Implement and manage CI/CD pipelines for data workflows, enabling automated deployments and version control.
• Work with AWS services to build, deploy, and monitor cloud-based, scalable data solutions.
• Leverage Apache Airflow for orchestrating workflows and PostHog for analytics tracking and event data.
• Manage and enhance data warehousing solutions to support business intelligence and analytics needs.
• Ensure data accuracy, consistency, and security across diverse systems and sources.
• Troubleshoot and optimize data systems for performance, scalability, and cost efficiency.
• Actively promote and contribute to a collaborative, innovative, and agile team

Benefits

• Creative workspaces
• Flexibility to work from home or in the office
• All equipment needed to be successful at work