More jobs:
Databricks Architect
Job in
St. Louis, Saint Louis, St. Louis city, Missouri, 63105, USA
Listed on 2026-03-11
Listing for:
Envision
Full Time
position Listed on 2026-03-11
Job specializations:
-
IT/Tech
Data Engineer, Cloud Computing
Job Description & How to Apply Below
Must be a US Citizen, no third party candidates, no Corp to Corp candidates.
About the RoleLead the architectural setup and migration strategy for data platform. The primary objective is to transition our existing Azure Data Factory (ADF) orchestration and transformation logic into a robust, scalable Databricks Lakehouse environment while establishing long-term best practices for our internal team.
Responsibilities- Define and implement best practices for Unity Catalog, workspace security, compute policies, and cost management (Fin Ops) for Platform Governance.
- Audit current ADF pipelines and design a phased migration plan to Delta Live Tables (DLT) or PySpark-based workflows.
- Establish automated deployment pipelines (Azure Dev Ops/Git Hub Actions) for Databricks notebooks and libraries. CI/CD & Dev Ops
- Build reusable templates for data ingestion (Bronze), cleaning (Silver), and business modeling (Gold).
- Create comprehensive technical documentation covering architectural decisions, naming conventions, and operational runbooks.
- Mentor the data team on Databricks-native development patterns to ensure a seamless handoff at 6 months.
- Bachelor Degree minimum
- 5+ years of experience with Spark/Databricks
- 3+ years specifically within the Azure ecosystem
- Advanced proficiency in PySpark, SQL, Unity Catalog, and Delta Lake architecture
- Experience replacing ADF-heavy logic with Databricks Workflows or Airflow.
- Proven track record of migrating legacy ETL/ADF workloads to Databricks.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×