Senior Azure Data Engineer

Location: Bengaluru

Job Title
Senior Azure Data Engineer

Experience
6–8 years of experience in data engineering, with strong hands-on work in the Azure data ecosystem

Job Summary
We are looking for a Senior Azure Data Engineer with deep hands-on experience across Azure Data Factory, Azure Data Lake, and Azure Databricks. This role focuses on designing, building, and optimizing scalable, reliable data pipelines and analytics platforms on Azure. You will work closely with architects, analysts, and business teams to deliver production-grade data solutions.

Key Responsibilities
Design, develop, and maintain end-to-end data pipelines using Azure Data Factor
Build robust data ingestion, transformation, and orchestration workflows
Work extensively with Azure Data Lake for structured and unstructured data storage
Develop and optimize data processing solutions using Azure Databricks with Py Spark
Ensure data quality, reliability, and performance across data pipelines
Collaborate with data architects, analysts, and business stakeholders to align data solutions with requirements
Optimize cost, performance, scalability, and security across Azure data services
Implement CI/CD pipelines and follow Dev Ops best practices using Git and Azure Dev Ops
Monitor, troubleshoot, and resolve production issues, including performance tuning

Required Skills and Experience
Strong hands-on experience with Azure Data Factory (ADF)
Proven experience working with Azure Data Lake (ADLS Gen2 preferred)
Solid hands-on experience with Azure Databricks and Py Spark

Experience with Azure Synapse Analytics
Exposure to security, access control, and data governance in Azure
Strong understanding of data warehousing concepts and data modeling basics
Advanced SQL skills, including query optimization and performance tuning
Experience building and maintaining production-grade data pipelines
Familiarity with CI/CD practices, Git, and Azure Dev Ops