Lead Databricks Engineer

Databricks, ADFA Databricks

Job Description (JD) typically involves designing, developing, and maintaining scalable data pipelines, ETL processes, and data solutions using the Databricks platform (Lakehouse Architecture, Spark, Delta Lake) on cloud services (AWS, Azure, GCP).

Key responsibilities include data modeling, performance optimization, ensuring data quality security, collaborating with data scientists analysts, and implementing governance (like Unity Catalog) for big data analytics and AIML initiatives. Common Roles Responsibilities Databricks Developer Engineer Architect Builds data infrastructure, optimizes Spark jobs, creates ETLELT pipelines, and integrates with cloud services. Responsibilities Design develop data solutions on Databricks (Delta Lake, Unity Catalog).Optimize

data pipelines (batch streaming) for performance. Collaborate with stakeholders (scientists, analysts).Implement data quality, security, and governance. Troubleshoot performance issues. Document technical specs.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.