Senior Azure Data Engineer

Location: Bengaluru

Job Title

Senior Azure Data Engineer

Experience

6–8 years of experience in data engineering, with strong hands-on work in the Azure data ecosystem

Job Summary

We are looking for a Senior Azure Data Engineer with deep hands-on experience across Azure Data Factory, Azure Data Lake, and Azure Databricks. This role focuses on designing, building, and optimizing scalable, reliable data pipelines and analytics platforms on Azure. You will work closely with architects, analysts, and business teams to deliver production-grade data solutions.

Key Responsibilities

- Design, develop, and maintain end-to-end data pipelines using Azure Data Factor
- Build robust data ingestion, transformation, and orchestration workflows
- Work extensively with Azure Data Lake for structured and unstructured data storage
- Develop and optimize data processing solutions using Azure Databricks with Py Spark
- Ensure data quality, reliability, and performance across data pipelines
- Collaborate with data architects, analysts, and business stakeholders to align data solutions with requirements
- Optimize cost, performance, scalability, and security across Azure data services
- Implement CI/CD pipelines and follow Dev Ops best practices using Git and Azure Dev Ops
- Monitor, troubleshoot, and resolve production issues, including performance tuning

Required Skills and Experience

- Strong hands-on experience with Azure Data Factory (ADF)
- Proven experience working with Azure Data Lake (ADLS Gen2 preferred)
- Solid hands-on experience with Azure Databricks and Py Spark

- Experience with Azure Synapse Analytics
- Exposure to security, access control, and data governance in Azure
- Strong understanding of data warehousing concepts and data modeling basics
- Advanced SQL skills, including query optimization and performance tuning
- Experience building and maintaining production-grade data pipelines
- Familiarity with CI/CD practices, Git, and Azure Dev Ops