Senior Data Engineer

Location: Bengaluru

Job Title:

Data Engineer / Azure Databricks Data Engineer

Experience:

5 – 10 Years

Employment Type:

Full-Time
Location :

- Bengaluru / Hyderabad /  Chennai / Pune / Noida / Coimbatore
Industry: Product / SaaS / Enterprise / Technology Services

Job Summary

We are seeking a highly skilled Data Engineer with strong experience in Azure Cloud, Azure Databricks, and Python to design, build, and maintain scalable data platforms. The ideal candidate will be responsible for developing robust data pipelines, optimizing data workflows, and enabling analytics and data-driven decision-making across the organization.

This role requires hands-on expertise in big data processing, cloud-native data engineering, and working with large-scale datasets in an enterprise environment.

Location :

- Bengaluru / Hyderabad /  Chennai / Pune / Noida / Coimbatore

Key Responsibilities

Design, develop, and maintain scalable data pipelines using Azure Databricks and Python
Build and optimize ETL/ELT workflows for structured and unstructured data
Work with large-scale datasets to support analytics, reporting, and machine learning use cases
Develop and manage data solutions on Microsoft Azure Cloud
Implement data ingestion from multiple sources such as APIs, databases, files, and streaming platforms
Optimize Databricks jobs for performance, reliability, and cost efficiency
Collaborate with data scientists, analysts, and business stakeholders to understand data requirements
Ensure data quality, data governance, security, and compliance best practices
Monitor and troubleshoot data pipelines in production environments
Participate in code reviews and ensure adherence to engineering best practices
Document data architecture, pipelines, and operational procedures.

Location :

- Bengaluru / Hyderabad /  Chennai / Pune / Noida / Coimbatore

Required Skills & Experience
Core Skills
5–10 years of hands-on experience as a Data Engineer
Strong proficiency in Python for data engineering and automation
Extensive experience with Azure Databricks
Solid understanding of Azure Cloud services, including:
Azure Data Factory
Azure Data Lake Storage (ADLS Gen2)
Azure Synapse Analytics (good to have)
Strong SQL skills for data querying and transformation
Experience working with big data technologies and distributed computing concepts
Hands-on experience in designing and managing ETL/ELT pipelines

Good to Have (Nice to Have)

Experience with Spark (PySpark) and performance tuning
Knowledge of Delta Lake and data versioning
Exposure to CI/CD pipelines for data engineering workloads

Experience with data modeling and dimensional modeling concepts
Familiarity with streaming technologies (Kafka, Event Hubs)
Azure certifications (DP-203, AZ-900, etc.)

Location :

- Bengaluru / Hyderabad /  Chennai / Pune / Noida / Coimbatore