At MarketOnce, we empower businesses with the insights and strategies they need to excel in today's dynamic market. We value curiosity, creativity, collaboration, and expertise, continuously striving to push boundaries and exceed our clients' expectations.
Requirements
- 7+ years in data engineering, big data platforms, or a related discipline with hands-on production experience at scale
- Expert-level SQL skills — complex joins, CTEs, window functions, query plan analysis, and optimization across both OLTP (PostgreSQL) and distributed engines (Spark SQL, Databricks SQL, Delta Lake)
- Hands-on experience with data lake technologies and data pipeline frameworks (e.g., Azure Data Lake, Azure Data Factory, Databricks)
- Deep expertise in Apache Spark — DataFrames, Spark SQL, UDFs, partitioning, broadcast strategies, and hands-on performance tuning experience
- Data warehouse and visualization experience, including demonstrated strong Logical, Physical, and Dimensional Modeling skills
- Strong PostgreSQL experience — schema design, indexing strategies, partitioning, EXPLAIN/ANALYZE tuning, and extensions including pgvector for similarity search
- Strong Python skills — PySpark, pandas, async programming, building production data utilities
- Excellent verbal and written communication skills to document and present data models, strategies, standards, and concepts to both business and IT audiences
Benefits
- Competitive base salary: $150,000-$180,000/year
- Flexible vacation policy – take the time you need to recharge
- Comprehensive health, vision & dental insurance
- 401k with company contribution
- Opportunity for career progression with plenty of room for personal growth