Data Engineer

Location: Bengaluru

About

The Role

We are seeking a skilled and detail-oriented  Data Engineer  to join our team. You will be responsible for designing, developing, and maintaining scalable ETL pipelines, optimizing data infrastructure, and ensuring data integrity through governance best practices. This role involves working closely with quantitative teams and developers to build robust data solutions while leveraging cutting-edge big data technologies and cloud platforms.

Key Responsibilities

Design, develop, and maintain scalable ETL pipelines for multi-scale datasets.
Architect and optimize high-performance data pipelines for seamless data flow and transformation.
Implement data quality checks and governance processes to ensure data integrity and accuracy.
Utilize web scraping techniques to extract, transform, and load data from diverse sources.
Collaborate with Quantitative teams and developers to optimize and scale data infrastructure.
Ensure the reliability, efficiency, and scalability of data pipelines.
Monitor and troubleshoot data processes to ensure optimal performance.

Essential Requirements

3-6 years of experience as a Data Engineer.
Strong programming skills in Python, Java, or Scala.
Expertise in SQL, data modeling, and working with relational and non-relational databases.
Hands-on experience with Azure (mandatory), and familiarity with AWS or GCP.
Proficiency in Hadoop, Spark, Kafka, and other big data technologies.
Strong analytical and problem-solving skills.

Preferred Qualifications

Master's degree in Computer Science, Data Science, or a related field.

Experience with real-time data processing and governance best practices.
Familiarity with CI/CD pipelines and data version control.

What We Offer

Competitive compensation and benefits package.
Opportunities to work with advanced big data technologies and cloud platforms.
Collaborative and innovative work environment.
Professional growth and development opportunities.