Data Engineer

Location: Bengaluru

About the Company:

Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 2000+ employees, we provide the intimacy of a boutique consultancy with the capabilities of a large IT services firm.

Role :
Data Engineer

Work Location :
Bangalore

Experience : 5+ Years

Technical Skill : SQL, Python/PySpark, AWS

JD and required Skills & Responsibilities:

- Actively participate in all phases of the software development lifecycle, including requirements gathering, functional and technical design, development, testing, roll-out, and support.
- Solve complex business problems by utilizing a disciplined development methodology.
- Produce scalable, flexible, efficient, and supportable solutions using appropriate technologies.
- Analyse the source and target system data. Map the transformation that meets the requirements.
- Interact with the client and onsite coordinators during different phases of a project.
- Design and implement product features in collaboration with business and Technology stakeholders.
- Anticipate, identify, and solve issues concerning data management to improve data quality.
- Clean, prepare, and optimize data at scale for ingestion and consumption.
- Support the implementation of new data management projects and re-structure the current data architecture.
- Implement automated workflows and routines using workflow scheduling tools.
- Understand and use continuous integration, test-driven development, and production deployment frameworks.
- Participate in design, code, test plans, and dataset implementation performed by other data engineers in support of maintaining data engineering standards.
- Analyze and profile data for the purpose of designing scalable solutions.
- Troubleshoot straightforward data issues and perform root cause analysis to proactively resolve product issues.

Required Skills

- 3+ years’ of relevant experience developing Data and analytic solutions.
- Experience building data lake solutions leveraging one or more of the following AWS, EMR, S3, Hive & Py Spark

- Experience with relational SQL

- Experience with scripting languages such as Python

- Experience with source control tools such as Git Hub and related dev process

- Experience with workflow scheduling tools such as Airflow
- In-depth knowledge of AWS Cloud (S3, EMR, Databricks)
- Has a passion for data solutions.
- Has a strong problem-solving and analytical mindset

- Working experience in the design, Development, and test of data pipelines.
- Experience working with Agile Teams.
- Able to influence and communicate effectively, both verbally and in writing, with team members and business stakeholders
- Able to quickly pick up new programming languages, technologies, and frameworks.
- Bachelor’s Degree in computer science

Why choose GSPANN

“We GSPANNians” are at the heart of the technology that we pioneer. We do not service our customers, we co-create.

With the passion to explore solutions to the most challenging business problems, we support and mentor the technologist in everyone who is a part of our team. This translates into innovations that are path-breaking and inspirational for the marquee clients, we co-create a digital future with.

GSPANN is a work environment where you are constantly encouraged to sharpen your abilities and shape your growth path, We support you to become the best version of yourself by feeding your curiosity, providing a nurturing environment, and giving ample opportunities to take ownership, experiment, learn and succeed.

We’re a close-knit family of more than 2000 people that supports one another and celebrates successes, big or small. We work together, socialize together, and actively serve the communities we live in.

We invite you to carry forward the baton of innovation in technology with us.

At GSPANN, we do not service. We Co-create.

Discover your inner technologist - Explore and expand the boundaries of tech innovation without the fear…