Databricks Data Architect

We are seeking a senior Data Architect with deep Databricks expertise to join a global consulting firm. In this role you will help lead the design, modernization, and implementation of enterprise‑scale data platforms. This role combines architecture ownership, hands‑on execution, and technical leadership, guiding clients through data platform evolution while mentoring engineering teams and partnering closely with stakeholders.

Our ideal candidate has strong experience designing lakehouse architectures, leading Databricks migrations, and establishing governance, scalability, and best practices using Delta Lake, Delta Live Tables, and Unity Catalog.

• Define and evolve enterprise data architecture using Databricks Lakehouse patterns, including Medallion architecture (Bronze/Silver/Gold).
• Design conceptual, logical, and physical data models that support analytics, reporting, and machine learning use cases.
• Lead migration of legacy data platforms and pipelines to modern Databricks frameworks, ensuring scalability, performance, and cost efficiency.
• Establish reference architectures, standards, and best practices for ingestion, transformation, orchestration, and governance.

• Design, build, and maintain reusable data products using Databricks, Delta Live Tables (DLT), PySpark, and SQL.
• Develop and optimize batch and streaming data pipelines, including file compaction and performance tuning strategies.
• Contribute directly to implementation while guiding data engineers through design decisions, code reviews, and delivery.
• Troubleshoot and resolve complex data platform and pipeline issues.

• Design and implement Databricks Unity Catalog–enabled architectures, including workspace migrations.
• Create and manage group‑based ACLs, compute policies, and governance controls within Unity Catalog.
• Ensure adherence to data security, privacy, and compliance requirements (RBAC, encryption, lineage, auditing).
• Define and enforce CI/CD and Dev Ops practices for data engineering, including version control, automated testing, and infrastructure‑as‑code deployments.
• Partner with stakeholders (Data Product Owners, Analytics, Security, Infrastructure) to translate business requirements into technical solutions.
• Provide architectural guidance from discovery through implementation, including roadmap creation and delivery planning.
• Stay current on emerging data engineering and Databricks platform capabilities and recommend adoption when appropriate.

• Proven experience as a Data Architect or Senior Data Engineer with strong architectural ownership.
• Deep hands‑on expertise with Databricks, including Delta Lake, Delta Live Tables, and Unity Catalog.
• Strong proficiency in PySpark and SQL for large‑scale data processing.
• Experience designing dimensional models and Medallion‑based lakehouse architectures.
• Demonstrated success migrating Databricks work spaces and data models to Unity Catalog‑enabled environments.
• Strong experience managing ACLs, governance policies, and compute controls in Databricks.
• Hands‑on experience with data orchestration and pipeline tools such as Azure Data Factory or AWS Glue.
• Experience working with cloud data lakes (Azure Storage and/or AWS S3).
• Strong understanding of batch and streaming data processing patterns.
• Experience applying Dev Ops and CI/CD principles (Git, Azure Dev Ops, CI/CD pipelines, IaC).

• Experience designing enterprise‑grade data lake and lakehouse architectures.
• Exposure to broader cloud services (Azure messaging, serverless compute, networking, storage).
• Experience supporting analytics and BI platforms such as Power BI or Tableau.
• Familiarity with streaming platforms (Kafka, Event Hubs) and CDC patterns.
• Databricks certifications (Data Engineer or Architect).

Special Note — They are not able to provide sponsorship now or in the future.

Location:

Dallas, TX | Salary: $87,500 – $145,000