Service lead

Locations:
Hyderabad, Chennai,

Experience:

10-15 Years
Role:
Service lead

Must-Have:
Pyspark, SQL
AWS data platforms tools like Glue, EMR, RDS, Redshift, EC2
Airflow
Responsibility:
Design and maintain optimal data pipeline architecture
Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Design and build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS data platform technologies.
Work with stakeholders including the Executive, Product, Data and Architect teams to assist with data-related technical issues and support their data infrastructure needs.

Technical skills:
Experience in designing, building and optimizing data pipelines, architectures and data sets in any of the cloud-based data platforms.
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Design and Build processes supporting data transformation, data structures, metadata, dependency and workload management.
A successful history of manipulating, processing and extracting value from large datasets.

Good to Have:
5+  years of experience   in a  Data Engineer  role