As a member of the Data Pipeline team, you'll be at the center of building our platform that enables us to redefine the Commercial Real Estate industry. You will be designing and building data projects while securing core data elements.
Requirements
- 5+ years of professional experience in data engineering or a closely related field.
- 5 -8 years of hands-on Apache Spark experience (PySpark preferred)
- Proven experience building and maintaining ETL/ELT pipelines using tools/frameworks such as PostgreSQL, Docker, Apache Airflow, AWS Step Functions, or similar.
- 1-2 years of experience building high-performance algorithms in scalable languages such as Scala, Python and R
- Strong expertise in SQL (complex queries, performance tuning, analytical functions)
- Excellent interpersonal, verbal and written communication skills
- Experience mentoring junior engineers and performing code reviews
- Strong logical, analytical, problem solving and reporting skills
- AWS Elastic Map Reduce (EMR) experience
- Experience with modern data warehousing and/or lakehouse architecture.
- Familiarity with CI/CD, Git, and agile development practices.
- Experience managing large scale products with a passion for quality/efficiency.
Benefits
- Leaves
- Transportation
- Medical Insurance
- Learn while you Earn
- Wellness