Senior Software Development Engineer, Big Data

Join the Housing Trends Data Engineering team at Zillow Group and contribute to the creation of innovative analysis, creativity, and excellence in the U.S. housing market. You'll work on designing, building, and orchestrating batch and real-time data pipelines, processing large-scale datasets from diverse sources, and collaborating with cross-functional teams to drive effective customer engagement.

Requirements

• Strong proficiency in Python programming
• Hands-on experience with big data ecosystems, architectures, and modern data platforms, including AWS cloud data services and Lakehouse/Lakebase platforms
• Hands-on experience with Databricks is a significant advantage
• Proven ability to design, build, and orchestrate batch and real-time data pipelines, processing large-scale datasets from diverse sources
• Practical experience with cutting-edge data engineering technologies such as SparkSQL and Spark Streaming, PostgreSQL, EKS, and Kubernetes
• Familiarity with Agile/DevOps software development processes and tools such as GitLab and CI/CD
• A good understanding of data science concepts, fundamental machine learning algorithms/libraries, and development lifecycle is a must-to-have
• Familiarity with LLM and Agentic AI technologies and engineering patterns is a big advantage
• Strong ability in performing root cause analysis to address operational issues and identify opportunities for improvement
• Exceptional communication skills to drive effective customer engagement, collaborate with cross-functional teams, and clearly articulate technical concepts to technical and non-technical stakeholders
• Strong problem-solving skills and the ability to work in a fast-paced, collaborative environment

Benefits

• Competitive base salary
• Equity awards based on factors such as experience, performance, and location
• Opportunities for professional growth and development