More jobs:
Senior Databricks Data Engineer
Job Description & How to Apply Below
Overview
This is a remote position.
Title:
Senior Databricks Data Engineer (many roles to fill)
Location:
In Toronto, Montreal, or Ottawa
Job Type: Full-time or Contract
Experience Level: Senior
Rate and salary: up to $100 per hour (contract), or up to $160,000 per year (employee)
Role Overview:
We’re hiring a Senior Databricks Data Engineer to lead the development of high-performance, scalable data infrastructure using Databricks on Azure
. The ideal candidate is a seasoned data engineer with deep Spark/Databricks experience
, strong software engineering fundamentals, and a track record of delivering data solutions in cloud-native environments.
Certification is required (Associate; Professional preferred).
- Architect, build, and maintain scalable data pipelines and ETL/ELT processes using Databricks and Apache Spark
. - Develop, test, and deploy data engineering codebases using best practices in version control (Git), CI/CD, and code modularity
. - Optimize pipeline performance for cost and compute efficiency
, leveraging Databricks Workflows
, Delta Lake
, and Auto Loader
. - Work with Azure cloud services
: ADLS Gen2, Azure Data Factory, Synapse Analytics, and Azure Dev Ops. - Integrate data from APIs, event streaming sources (Kafka, Event Hubs), and traditional data warehouses.
- Apply data governance, cataloging, and access control using Unity Catalog
, RBAC, and compliance best practices. - Implement monitoring, alerting
, and logging for data pipelines using tools like Datadog
, Prometheus
, or native cloud tools. - Collaborate in an Agile/Scrum team setup and participate in planning, code reviews, retrospectives, and sprint demos.
- Experience with Git Hub for version control, code collaboration, and integrating CI/CD workflows.
- 5+ years in data engineering with hands-on Spark/Databricks experience
. - Databricks Certified Data Engineer Associate is required
;
Professional is highly preferred
. - Strong experience in cloud environments
: primarily Azure
, and ideally AWS or GCP
. - Proficient in Python (PySpark),
SQL
, and data pipeline orchestration
. - Experience working with Delta Lake
, Delta Live Tables
, and streaming frameworks like Structured Streaming
. - Expertise in Git-based workflows
, including pull requests, branching strategies, and collaboration using platforms like Git Hub, Git Lab, or Azure Repos
. - Hands-on experience with CI/CD tools such as Azure Dev Ops Pipelines, Git Hub Actions, Jenkins
, or CircleCI
. - Familiar with IaC tools like Terraform or ARM templates
. - Deep understanding of data modeling (OLAP/OLTP, star/snowflake schema),
data quality
, and metadata management
. - Exposure to data quality frameworks like Great Expectations or Deequ
.
- Experience with Unity Catalog
, MLflow
, or Feature Store in Databricks. - Familiarity with containerized deployments (Docker, Kubernetes).
- Knowledge of data observability and lineage tracking tools like Monte Carlo
, Open Lineage
, or Collibra
. - Background in Dev Sec Ops and building secure data pipelines
. - Ability to mentor junior engineers and lead technical initiatives across teams.
- French ability if in Montreal is a huge asset.
- Strong problem-solving skills and analytical thinking.
- Comfortable working in a fast-paced Agile environment.
- Excellent verbal and written communication skills.
- Collaborative mindset with a focus on cross-functional impact
.
- What We Offer:
- Competitive salary + performance-based bonuses
- Flexible work arrangements (remote/hybrid)
- Certification and learning support
- Work with cutting-edge data tech stack
- Opportunities for leadership and technical ownership
Position Requirements
10+ Years
work experience
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
Search for further Jobs Here:
×