Platform and Databricks DevOps Engineer

Overview

Job Number: R0232406

Platform and Databricks Dev Ops Engineer

As a Databricks Platform Dev Ops Engineer at Booz Allen, you'll lead the design, automation, and reliable operation of Databricks Lakehouse environments that power mission-critical analytics, AI, and data initiatives for defense, intelligence, and civil clients. You'll drive CI/CD maturity, infrastructure as code, platform governance, and operational excellence to deliver secure, scalable, and cost-optimized Databricks platforms at enterprise scale.

Join a high-impact team that accelerates national security outcomes through advanced Dev Ops practices on Databricks. Enable clients to achieve data and decision superiority by automating complex platform deployments, enforcing compliance, and continuously improving performance and reliability.

• Managing account and workspace administration, including creating and managing work spaces, configuring settings, enabling features such as serverless compute or Previews, and handling account-level configurations via the account console
• Overseeing identity and access management - provisioning users, groups, and service principals via SCIM, assigning roles and entitlements, managing workspace assignments, and enforcing least-privilege access
• Implementing and governing Unity Catalog metastore, catalogs, schemas, tags, lineage, sharing, and fine-grained access controls to ensure data security, compliance, and discoverability across work spaces
• Administering compute resources - creating and managing cluster policies, instance pools, job clusters, serverless options, Photon engine usage, and resource limits to standardize environments and control costs
• Owning infrastructure as code deployments such as Terraform and Databricks Terraform Provider, across multiple environments, such as dev, test, staging, and production, with strong governance and rollback capabilities
• Designing and maintaining automation for notebooks, clusters including serverless and Photon-optimized, Delta Live Tables pipelines, Workflows and jobs, and Delta Lake configurations
• Monitoring platform health, performance, and costs - accessing audit logs, billable usage dashboards, system tables, and operational metrics, setting budget alerts, and optimizing spend
• Enforcing security and compliance best practices, including encryption, private networking, IP access lists, credential management, and alignment with FedRAMP and DoD standards
• Automating administrative tasks using Databricks REST APIs, Terraform Databricks Provider, Asset Bundles, scripting, including Python or Bash, and CI/CD integrations for repeatable, auditable operations
• Troubleshooting complex issues, performing root-cause analysis, maintaining disaster recovery and backup strategies, and providing Tier-3 support to users, data engineers, and platform teams
• Mentoring junior administrators, conducting platform reviews, documenting procedures, and staying current with Databricks features such as Lakeflow or enhanced governance, to evolve client environments

• 3+ years of experience in Databricks administration, cloud platform operations, data platform engineering, or Dev Ops or infrastructure roles
• Experience administering Databricks, such as account console, workspace settings, Unity Catalog, and compute or cluster management
• Experience with identity federation, including SCIM provisioning, role-based access control, and governance in cloud data platforms
• Experience scripting or automation in platforms such as Python or Bash for administrative tasks
• Experience with cloud platforms, such as AWS or GCP, including storage (e.g., ADLS or S3), networking, IAM, and security configurations
• Knowledge of Terraform or IaC tools, REST APIs, and monitoring and observability concepts
• Ability to collaborate with technical teams and stakeholders
• Ability to obtain a Secret clearance
• Bachelor's degree

• Experience developing enterprise cloud-native solutions involving Kubernetes, Docker, AWS, or Jenkins
• Experience with Azure a plus
• Experience with creating and improving continuous automation across multiple technical stacks
• Experience with creating and improving…