More jobs:
Data Engineering Lead
Job in
New York, New York County, New York, 10261, USA
Listed on 2026-03-01
Listing for:
Elevanta Partners
Full Time
position Listed on 2026-03-01
Job specializations:
-
IT/Tech
Data Engineer, Data Science Manager
Job Description & How to Apply Below
Industry: Private Equity / Capital Markets
About the Company and the roleWe are seeking an experienced Data Engineering Lead to drive large-scale data initiatives for a Private Equity firm based in New York. This is a hands‑on leadership role where you will architect, build, and lead modern data platforms on Azure Databricks while managing an offshore delivery team. You will work closely with business stakeholders, technology partners, and leadership to deliver high‑quality, scalable data solutions that support investment, reporting, and analytics use cases.
Responsibilities- Act as the onsite lead and primary point of contact for data engineering initiatives
- Manage and mentor an offshore team of 5–7 data engineers and data testers, ensuring delivery quality and timelines
- Architect and implement robust, scalable data pipelines using PySpark and SQL
- Define and enforce best practices for data engineering, performance optimization, and data quality
- Work closely with data architects and stakeholders to align data solutions with enterprise data architecture
- Leverage Unity Catalog for data governance, security, and access control
- Collaborate with business users, analysts, and leadership to translate business requirements into technical solutions
- 15+ years of experience delivering large-scale data programs in enterprise environments
- Databricks Certified Data Engineer with 5+ years of experience leading Azure Databricks programs
- Strong hands‑on experience with PySpark, including 5+ years delivering production‑grade data pipelines
- Solid working knowledge of Unity Catalog and modern data governance practices
- Strong understanding of data architecture principles, including data lakes, lakehouse patterns, and ETL/ELT design
- Advanced SQL skills for data transformation, analysis, and optimization
- Proven experience managing offshore teams of data engineers and data testers
- Excellent communication skills with the ability to engage both technical and non‑technical stakeholders
- Experience working on Private Equity or Capital Markets data programs
- Prior experience in regulated or high‑performance data environments
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×