Abacus Insights is looking for a Data Engineer to join their growing Tech Ops division. The ideal candidate will have experience working with distributed data processing systems in modern cloud environments and proficiency in Python and SQL.
Requirements
- Bachelor's degree in Computer Science, Computer Engineering, or a closely related technical field
- 2+ years of hands-on experience as a Data Engineer
- Proficiency in Python and SQL
- Experience building and managing ETL pipelines using Databricks workflows or similar tools
- Familiarity with structured and semi-structured data and processing with PySpark
- Basic knowledge of cloud services such as AWS (S3, SQS) or equivalent
- Understanding of version control and CI/CD tools (e.g., GitLab)
- Ability to optimize queries and troubleshoot performance issues in SQL or SparkSQL
- Exposure to data warehousing technologies like Snowflake or similar platforms
Benefits
- Competitive Leave & Benefits
- Comprehensive health coverage
- Equity for every employee