Azure Data Tech Lead

Role description

Azure Data Tech Lead — Specialist II - Software Engineering

You Are:

We are looking for an experienced Senior/Lead Data Engineer with 8+ years of expertise in designing and delivering scalable, high-performing data solutions on the Azure ecosystem.

• Architect, design, and implement scalable data platforms and pipelines on Azure and Databricks.
• Build and optimize data ingestion, transformation, and processing workflows across batch and real-time data streams.
• Work extensively with ADLS, Delta Lake, and Spark (Python) for large-scale data engineering.
• Lead the development of complex ETL/ELT pipelines, ensuring high quality, reliability, and performance.
• Design and implement data models, including conceptual, logical, and physical models for analytics and operational workloads.
• Work with relational and lakehouse systems including Postgre
  
  SQL and Delta Lake.
• Define and enforce best practices in data governance, data quality, security, and architecture.
• Collaborate with architects, data scientists, analysts, and business teams to translate requirements into technical solutions.
• Troubleshoot production issues, optimize performance, and support continuous improvement of the data platform.
• Mentor junior engineers and contribute to building engineering standards and reusable components.

• 8+ years of hands-on data engineering experience in enterprise environments.
• Strong expertise in Azure services, especially Azure Databricks, Functions, and Azure Data Factory (preferred).
• Advanced proficiency in Apache Spark with Python (PySpark).
• Strong command over SQL, query optimization, and performance tuning.
• Deep understanding of ETL/ELT methodologies, data pipelines, and scheduling/orchestration.
• Hands-on experience with Delta Lake (ACID transactions, optimization, schema evolution).
• Strong experience in data modelling (normalized, dimensional, lakehouse modelling).
• Experience in both batch processing and real-time/streaming data (Kafka, Event Hub, or similar).
• Solid understanding of data architecture principles, distributed systems, and cloud-native design patterns.
• Ability to design end-to-end solutions, evaluate trade-offs, and recommend best-fit architectures.
• Strong analytical, problem-solving, and communication skills.
• Ability to collaborate with cross-functional teams and lead technical discussions.

Preferred Skills

• Experience with CI/CD tools such as Azure Dev Ops and Git.
• Familiarity with IaC tools (Terraform, ARM).
• Exposure to data governance and cataloging tools (Azure Purview).
• Experience supporting machine learning or BI workloads on Databricks.

Compensation can differ depending on factors including but not limited to the specific office location, role, skill set, education, and level of experience. UST provides a reasonable range of compensation for roles that may be hired in various U.S. markets as set forth below.

Role

Location:

Georgia

Compensation Range
: $109,000-$164,000

Full-time, regular employees accrue a minimum of 10 days of paid vacation per year, 6 days of paid sick leave per year (pro-rated for new hires), 10 paid holidays, and are eligible for paid bereavement leave and jury duty. They are eligible for the Company 401(k) with employer matching, health insurance (medical, dental, vision), and other Company-paid benefits. Regular employees may purchase additional voluntary short-term disability benefits and participate in an HSA and FSA where allowed.

Benefits vary by location.

Part-time and temporary employees have pro-rated sick leave and 401(k) eligibility as described in the policy.

All US employees who work in states/localities with more generous paid sick leave laws will receive those benefits.

We proudly embrace Humility, Humanity, and Integrity. We strive for a people-first, human-centric culture that fosters diversity and sustainable solutions.

Humility: We listen, learn, and help selflessly in our interactions.

Humanity: Through business, we aim to better the lives of others.

Integrity: We honor commitments and act responsibly in all relationships.

UST is an Equal Opportunity Employer. All qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other protected characteristic. We will consider qualified applicants with arrest or conviction records in accordance with state and local laws and fair chance ordinances. UST reserves the right to redefine roles and responsibilities based on organizational needs and performance.

#UST

#CB

#LI-DU

Skills
: python, fullstack, hadoop, spark, ml, big data

Benefits

Compensation range: $ to $ per year