Custom Software Systems, Inc. is seeking an experienced EDP Platform Engineer / Databricks Administrator to serve as the hands-on technical owner of the agency’s Databricks platform supporting the Enterprise Data Platform (EDP). This role is responsible for end-to-end platform operations, security, and governance—ensuring the environment is compliant, reliable, cost-efficient, and capable of supporting secure analytics and AI/ML workloads at scale.
Requirements
- Administer Databricks account and workspaces across SDLC environments
- Configure and maintain clusters/compute, job compute, SQL warehouses, runtime versions, libraries, repos, and workspace settings
- Implement platform monitoring/alerting, operational dashboards, and health checks
- Provide Tier 2/3 operational support
- Manage change control for upgrades, feature rollouts, configuration changes, and integration changes
- Enforce least privilege across platform resources
- Configure and manage secrets and secure credential handling
- Enable and maintain audit logging and access/event visibility
- Administer Unity Catalog governance
- Configure and manage external locations, storage credentials, and governed access to cloud object storage
- Partner with governance stakeholders to support metadata/lineage integration, classification/tagging, and retention controls
- Coordinate secure connectivity and guardrails with cloud/network teams
- Configure cloud integrations required for governed data access and service connectivity
- Implement cost guardrails
- Produce usage/cost insights and optimization recommendations
- Automate administration and configuration using APIs/CLI/IaC
- Maintain platform documentation
- Design and implement backup and disaster recovery procedures
- Monitor and optimize platform performance
- Administer Delta Live Tables pipelines
- Manage third-party integrations and ecosystem connectivity
- Implement Databricks Asset Bundles for standardized deployment patterns
- Conduct capacity planning and scalability analysis
- Facilitate user onboarding and enablement
Benefits
- Health insurance plans
- Health Savings Account (HSA)
- Dental
- Vision
- Long-term disability
- Short-term disability
- Basic term life insurance
- Supplemental term life insurance for employees, spouses, and dependents
- Simple IRA
- Parking/Commuting expense reimbursement
