Senior Engineer, Data Engineering

Location: Bengaluru

Equal Opportunity Employer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, or disability status. EEO/Disabled/Vets

Job Description :

About

The Role

We are looking for a Senior Data Engineer

with experience in excellent analytical

abilities in GCP Big Query, ETL/BI, Python,

Composer/Airflow, SQL, GCP Services
- with the ability to operate in an agile

environment and keen to detail while

understanding the larger data warehouse.

Skills & Competencies

➔ A minimum of 4.5+ years of

working experience as a hands-on

data engineering is a must

➔ Advanced Degree in the field of

Computer Science, Data

Engineering, Data Analytics or

equivalent discipline

➔ Strong programming experience

with Python, SQL, ETL and

efficiently querying big datasets

using SQL

➔ Prior experience with CircleCI

CI/CD, Terraform and Github

version control is a must

➔ Solid understanding of Data

Collection, Data Ingestion, Data

Integration, and Data Operations

& Maintenance

➔ Implement data governance

practices, including data quality,

security, and compliance, in line

with organizational standards.

➔ Domain knowledge on News,

Media & Communications is an

added advantage

R E S P O N S I B I L I T I E S

➔ Design, build, and maintain scalable

ETL/ELT pipelines in Google Cloud, using

tools like Cloud Composer (Airflow), and

Big Query.

➔ Collaborate with cross-functional teams to

define data architecture and data

warehouse requirements

➔ Automate data pipelines, ETL/ELT

processes, and data integration workflows

using infrastructure-as-code (IaC) and

configuration management tools

➔ Deep understanding of Big Query,

including SQL, optimization techniques,

partitioning, clustering, and performance

tuning.

➔ Deliver production quality, modular,

reproducible code in Python, SQL

➔ Implement continuous integration and

continuous deployment (CI/CD) pipelines

for data pipelines and data-related

applications

➔ Keep abreast of the latest developments

in the field through continuous learning

and proactively champion promising new

methods relevant to the problems at hand.

Our Tech Stack

Google Cloud Platform is IaaS
Big Query, GCS, Python, SQL
Composer / Airflow - orchestration

tools

Terraform, Circle

CI, CI/CD, GIthub,

Jira, Confluence

This job is posted with NTS Technology Services Pvt. Ltd.

Job Category: