Palantir Data Pipeline & Metadata Lead responsible for establishing and scaling the data pipeline and metadata foundation that enables enterprise analytics, AI-driven capabilities, and system integration. The ideal candidate combines deep, demonstrable Palantir expertise, strong data architecture and governance experience, and the ability to lead teams and grow capabilities in complex, regulated environments.
Requirements
- Lead the design, development, and governance of enterprise data pipelines and metadata frameworks within Palantir Foundry and integrated data platforms.
- Serve as the technical and functional lead for data ingestion, transformation, and metadata management across structured and unstructured data sources.
- Define and enforce metadata standards, data models, ontologies, and data dictionaries to enable scalable search, analytics, and cross-system integration.
- Oversee implementation of end-to-end data pipelines, including ingestion, validation, transformation, and delivery into downstream platforms (e.g., Palantir, Databricks).
- Establish and govern data quality, validation, and exception handling processes, ensuring completeness, accuracy, and traceability of data assets.
- Ensure alignment of pipelines and metadata with enterprise architecture, system-of-record requirements, and integration patterns.
- Ensure pipelines effectively support document-based ingestion workflows, including integration with OCR/ICR outputs and downstream metadata extraction processes.
- Enable AI-ready data foundations, supporting downstream capabilities such as semantic search, entity resolution, and advanced analytics.
- Partner with data science and engineering teams to ensure data pipelines and metadata support AI/ML use cases and analytical workflows.
- Drive data governance and lifecycle management, including schema versioning, lineage tracking, auditability, and compliance with security and privacy requirements.
- Oversee integration across platforms (e.g., AWS, Databricks, Palantir), ensuring scalable, secure, and reliable data exchange.
- Lead and mentor teams in a matrixed, cross-functional environment, providing technical direction and quality oversight.
- Engage with senior stakeholders to define data strategy, prioritize initiatives, and translate business needs into technical solutions.
- Operate within an Agile delivery model, overseeing backlog prioritization, technical design reviews, and iterative delivery across workstreams.
Benefits
- Medical, Rx, Dental & Vision Insurance
- Personal and Family Sick Time & Company Paid Holidays
- Position may be eligible for a discretionary variable incentive bonus
- Parental Leave and Adoption Assistance
- 401(k) Retirement Plan
- Basic Life & Supplemental Life
- Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
- Short-Term & Long-Term Disability
- Student Loan PayDown
- Tuition Reimbursement, Personal Development & Learning Opportunities
- Skills Development & Certifications
- Employee Referral Program
- Corporate Sponsored Events & Community Outreach
- Emergency Back-Up Childcare Program
- Mobility Stipend
