Data Engineer III role at LexisNexis Legal & Professional, with a hybrid onsite schedule in Horsham, PA. The team deploys AI and advanced technologies to improve productivity and transform the business and practice of law. The Data Engineer III will work on large-scale data processing, data lake-based medallion architecture, and data engineering bug fixes.
Requirements
- Bachelor’s Degree (Engineering/Computer Science preferred but not required); or equivalent experience required.
- Hands-on experience in Azure Synapse Analytics, Azure Databricks, or Hadoop environments.
- Minimum 3 years of strong experience developing Python-based Spark code for large-scale data processing.
- Solid understanding of Big Data concepts, distributed computing, and data lake-based medallion architecture.
- Strong communication and collaboration skills to work with cross-functional teams.
- Strong proficiency in Python for data engineering, ETL, and automation tasks.
- Good working knowledge of Azure services, including Azure Data Factory (ADF) or Synapse Pipelines, Azure Data Lake Storage (ADLS), and Azure Key Vault/Secrets Management.
- Strong experience with writing SQL
- Experience working in both Linux and Windows environments for development and deployment.
- Solid working knowledge of GIT with Azure DevOps (Repos, Pipelines).
- Experience deploying code to higher environments using CI/CD pipelines & DevOps practices in Azure.
- Ability to troubleshoot, optimize, and monitor data pipelines in production.
- Exposure to Data Warehouses like AWS Redshift, Azure Dedicated SQL Pool, Netezza, etc.
- Familiarity with data security, governance, and compliance in cloud environments.
- Exposure to monitoring and logging frameworks for data workloads.
- Exposure to Microsoft Fabric.
- Knowledge of industry best practices (e.g., code coverage).
- Knowledge of software development methodologies (Agile).
- Good documentation skills.
- Attention to detail.
- Strong oral and written communication skills.
Benefits
- Health Benefits: Comprehensive, multi-carrier program for medical, dental and vision benefits
- Retirement Benefits: 401(k) with match and an Employee Share Purchase Plan
- Wellbeing: Wellness platform with incentives, Headspace app subscription, Employee Assistance and Time-off Programs
- Short-and-Long Term Disability, Life and Accidental Death Insurance, Critical Illness, and Hospital Indemnity
- Family Benefits, including bonding and family care leaves, adoption and surrogacy benefits
- Health Savings, Health Care, Dependent Care and Commuter Spending Accounts
- Up to two days of paid leave each to participate in Employee Resource Groups and to volunteer with your charity of choice
