Data Engineer

Looking for "Data engineer" for a global IT service provider Company Shimoga based Location.

Role :
Data Engineer
Experience : 5 Years - 8 Years
Skills :
Gcp , Aws , Pyspark , Data engineering .
Interview Mode :
Face to face

Job Summary :

We are looking for a skilled  Data Engineer  to design, build, and maintain scalable data pipelines and analytics solutions. The ideal candidate will have strong experience in  PySpark ,  Python , and  cloud platforms (AWS or GCP) , with the ability to work on large-scale data processing systems and support data-driven decision-making.

Key Responsibilities

Design, develop, and maintain  scalable ETL/ELT data pipelines  using  PySpark and Python .
Process and transform large volumes of structured and unstructured data.
Build and optimize data solutions on  AWS or GCP  (data lakes, warehouses, analytics platforms).
Ensure data quality, reliability, and performance across pipelines.
Collaborate with data analysts, data scientists, and business teams to understand data requirements.
Optimize Spark jobs for performance, cost, and scalability.
Implement data security, governance, and best practices.
Troubleshoot data issues and provide timely resolutions.

Required

Skills & Qualifications

Strong experience in  Python and PySpark .
Hands-on experience with  AWS or GCP  data services.
Solid understanding of  data engineering concepts , distributed systems, and big data processing.
Experience working with  SQL and relational databases .
Knowledge of  data warehousing and data lake architectures .
Familiarity with  Linux/Unix environments .

Preferred / Good to Have

Experience with  streaming frameworks  (Kafka, Spark Streaming, etc.).
Exposure to  CI/CD pipelines  and Dev Ops practices.
Knowledge of  data modeling and performance tuning .
Experience in Agile/Scrum environments.