We are seeking a Data Engineer III to join our team in Horsham, PA. As a Data Engineer III, you will be responsible for designing, building, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to translate business requirements into technical designs and implement data engineering and data management solutions. You will have hands-on experience with Azure Synapse Analytics, Azure Databricks, and Hadoop environments, as well as strong proficiency in Python for data engineering, ETL, and automation tasks.
Requirements
- Bachelor's Degree in Engineering/Computer Science or equivalent experience
- Hands-on experience in Azure Synapse Analytics, Azure Databricks, or Hadoop environments
- Minimum 3 years of strong experience developing Python-based Spark code for large-scale data processing
- Solid understanding of Big Data concepts, distributed computing, and data lake-based medallion architecture
- Strong communication and collaboration skills to work with cross-functional teams
- Strong proficiency in Python for data engineering, ETL, and automation tasks
- Good working knowledge of Azure services, including Azure Data Factory (ADF) or Synapse Pipelines, Azure Data Lake Storage (ADLS), and Azure Key Vault/Secrets Management
- Strong experience with writing SQL
- Experience working in both Linux and Windows environments for development and deployment
- Solid working knowledge of GIT with Azure DevOps (Repos, Pipelines)
- Experience deploying code to higher environments using CI/CD pipelines & DevOps practices in Azure
- Ability to troubleshoot, optimize, and monitor data pipelines in production
- Exposure to Data Warehouses like AWS Redshift, Azure Dedicated SQL Pool, Netezza, etc.
- Familiarity with data security, governance, and compliance in cloud environments
- Exposure to monitoring and logging frameworks for data workloads
- Exposure to Microsoft Fabric
- Knowledge of industry best practices (e.g., code coverage)
- Knowledge of software development methodologies (Agile)
- Good documentation skills
- Attention to detail
- Strong oral and written communication skills
Benefits
- Health Benefits
- Retirement Benefits
- Wellbeing
- Short-and-Long Term Disability, Life and Accidental Death Insurance, Critical Illness, and Hospital Indemnity
- Family Benefits
- Health Savings, Health Care, Dependent Care and Commuter Spending Accounts
- Up to two days of paid leave each to participate in Employee Resource Groups and to volunteer with your charity of choice
