Databricks Platform Engineer
Listed on 2026-01-14
-
IT/Tech
Data Engineer, Cloud Computing
Job Overview
Data Platform Engineering team is seeking an experienced Databricks Platform Engineer to help drive our enterprise data modernization strategy. This unique opportunity positions you at the forefront of our mission to accelerate advanced analytics, data science, and machine learning across the enterprise by building, managing, and evolving our Azure Databricks platform on Azure.
Position ScheduleFull‑time position. The posting will remain open for 30 days from 06‑Jan‑2026, though it may close earlier due to the volume of applicants.
What You Will Do- Design, implement, and manage scalable, secure Databricks platforms including workspace/cluster provisioning, lifecycle management, and resource optimization using Delta Lake and Photon.
- Automate provisioning and deployment using Terraform, Git Lab CI/CD, and scripting (Python, Bash, Power Shell) while building observability dashboards to monitor platform health, performance, and costs.
- Implement and enforce security policies, access controls, and compliance requirements using Unity Catalog and Databricks security features.
- Partner with data scientists, ML engineers, and product teams to deploy data pipelines and analytical services while resolving cluster configuration issues, job failures, and performance bottlenecks.
- Evaluate and adopt emerging Databricks capabilities, document architecture and best practices, mentor junior engineers, and participate in on‑call rotation for rapid incident response and platform stability.
- Actively support the Databricks platform on‑call rotation, providing expert assistance and rapid response for high‑priority incidents, escalations, and critical service interruptions.
- Bachelor’s degree in Computer Science, Information Systems or another applicable field is preferred.
- 5+ years of experience in Systems Administration.
- Minimum 3 years hands‑on experience designing, deploying, managing, and supporting Azure Databricks, Azure Data Lake Storage (ADLS), and related data solutions as a Platform Engineer/Administrator.
- Proficiency in automation and scripting tools including Terraform (IaC), Azure CLI, Databricks CLI, Power Shell, Python, REST API, SQL for infrastructure provisioning, deployment, andli>
- CI/CD and version control expertise with Git, Git Hub Actions, and related tools.
- Preferred experience in performance tuning of Azure ADLS and Databricks clusters, cost optimization strategies, and familiarity with data ingestion tools (Qlik Replicate, Apache Kafka, Matillion ELT, Snowflake).
- Agile development experience working collaboratively in cross‑functional product teams.
- Excellent communication skills with the ability to articulate complex system designs, architectural patterns, and technical solutions to stakeholders at all levels.
- Residential proximity to either Tempe, AZ or St. Louis, MO office location; expected to work onsite three days per week (preferably Tuesday through Thursday). Hybrid home‑based status may remain for selected internal associates.
Edward Jones provides a comprehensive compensation and benefits package that includes medical, prescription drug, dental, vision, voluntary benefits (accident, hospital indemnity, critical illness), short‑ and long‑term disability, basic life, and basic AD&D coverage (no cost to associates where applicable). Additional benefits include a 401(k) retirement plan, health savings account, flexible spending account, ten paid holidays, 15 days of vacation for new associates, sick time, personal days, paid day for volunteerism, bonus and profit‑sharing opportunities, and Employee Assistance Program.
For more information, visit the benefits page.
Hiring Minimum: $101,700 | Hiring Maximum: $173,200
Edward Jones does not discriminate on the basis of race, color, gender, religion, national origin, age, disability, sexual orientation, pregnancy, veteran status, genetic information or any other basis prohibited by applicable law.
#J-18808-Ljbffr(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).