Databricks Engineer — Spark, Delta Lake & Cloud Pipelines
Listed on 2026-03-01
-
IT/Tech
Data Engineer, Big Data, Cloud Computing, Data Science Manager
Role – Databricks Engineer
Location – Pleasanton, CA
Fulltime/FTE
Salary Range: $100000 to $130000/Annum
Job Description
Must Have Technical/Functional Skills
• 8+ years of skilled Databricks Developer to design, develop, and optimize data pipelines and analytics solutions using Databricks on cloud platforms (Azure/AWS/GCP). The ideal candidate will have strong experience in Spark, Python/Scala, and SQL, along with a solid understanding of big data processing and data engineering best practices
• Hands-on experience with Databricks and Apache Spark.
• Strong programming skills in Python and/or Scala.
• Proficiency in SQL for data manipulation and analysis.
• Experience with Delta Lake and Lakehouse architecture.
• Familiarity with cloud platforms (Azure Data Lake, AWS S3, or GCP).
• Knowledge of CI/CD pipelines and Dev Ops practices.
• Understanding of data modeling, data governance, and security.
• Experience with performance tuning for big data jobs.
Roles & Responsibilities
• Design and implement ETL/ELT pipelines using Databricks and Apache Spark.
• Develop and optimize data workflows for large-scale data processing.
• Integrate data from multiple sources into data lakes and data warehouses.
• Collaborate with data architects and analysts to deliver scalable solutions.
• Implement data quality checks, monitoring, and performance tuning.
• Work with Delta Lake for ACID transactions and data versioning.
• Deploy and manage Databricks clusters and jobs.
• Ensure compliance with security and governance standards.
• Participate in Agile ceremonies and contribute to continuous
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).