DataBricks Lead
Listed on 2026-03-01
-
IT/Tech
Data Engineer, Data Science Manager
About the role
As a Databricks Lead, you will make an impact by designing, implementing, and optimizing scalable data engineering solutions that power data-driven decision‑making across the organization. You will be a valued member of the Data Engineering & Cloud Analytics team and work collaboratively with architects, data engineers, and cross‑functional business partners to deliver high‑quality, enterprise‑grade data capabilities.
In this role, you will:- Lead the design and implementation of scalable data architectures using Databricks to support enterprise analytics and data engineering initiatives.
- Oversee Databricks Workspace Administration, Databricks CLI configuration, and workflow automation to ensure efficiency and compliance with engineering standards.
- Leverage Unity Catalog to enhance data governance, data lineage, access control, and security.
- Build and optimize structured streaming and real‑time data processing solutions.
- Architect and maintain large‑scale data storage solutions using Azure Data Lake Store.
- Develop production‑ready Python and PySpark code to support data ingestion, transformation, and automation.
- Implement Databricks SQL solutions to support complex analytical queries and reporting needs.
- Manage Databricks Workflows to enable reliable, high‑performing data pipelines.
- Collaborate closely with cross‑functional teams to align data solutions with business goals and drive innovation.
- Ensure all data solutions meet regulatory, security, and industry best‑practice standards.
- Monitor platform performance, troubleshoot issues proactively, and ensure system reliability and availability.
We believe hybrid work is the way forward as we strive to provide flexibility wherever possible. Based on this role’s business requirements, this is a hybrid position requiring 2–3 days per week in a client or Cognizant office in Addison, TX.
Regardless of your working arrangement, we are here to support a healthy work‑life balance through our various wellbeing programs.
The working arrangements for this role are accurate as of the date of posting and may change based on project, business, and client requirements. Rest assured; we will always be clear about role expectations.
What you need to have to be considered- 10–14 years of hands‑on experience across Databricks and Azure data engineering technologies.
- Strong experience with Databricks Workspace Admin, Databricks CLI, Unity Catalog, and Databricks SQL.
- Proficiency in Python and PySpark for building scalable data ingestion and transformation pipelines.
- Experience designing and managing large datasets in Azure Data Lake Store.
- Strong understanding of structured streaming and real‑time data processing frameworks.
- Ability to architect, automate, and optimize data workflows using Databricks Workflows.
- Strong understanding of data governance, security, and compliance best practices.
- Experience troubleshooting system and pipeline issues to maintain platform reliability.
- Ability to collaborate with technical and business teams to align data solutions with organizational needs.
Proven experience leading cloud‑based data initiatives in an enterprise environment.
- Advanced expertise in performance optimization within Databricks and Azure ecosystems.
- Experience supporting regulated industries or complex governance environments.
- Strong communication and ability to influence senior technical and business stakeholders.
- Databricks Certified Data Engineer Associate
- Microsoft Certified (Azure‑related specialization)
We’re excited to meet people who share our mission and can make an impact in a variety of ways. Don’t hesitate to apply, even if you only meet the minimum requirements listed. Think about your transferable experiences and unique skills that make you stand out as someone who can bring new and exciting strengths to this role.
Salary and Other CompensationApplications will be accepted until February 28, 2026.
The annual salary for this position is between $ 130,000 – $ 150,000 depending on experience and other qualifications of the successful candidate.
This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.
Benefits- Medical/Dental/Vision/Life Insurance
- Paid holidays plus Paid Time Off
- 401(k) plan and contributions
- Long‑term/Short‑term Disability
- Paid Parental Leave
- Employee Stock Purchase Plan
Disclaimer:
The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).