Hadoop Developer

Role:
As part of the product development team and reporting into the head of engineering, Hadoop Developers will help develop scalable ELT/ETL workflows to transform and integrate data into structures conducive for reporting and analytics on top of Teradata warehouses for one of the largest globally financial services companies. You will design and implement dimensional data models that scale across multiple data warehouses that will feed into Hadoop to replicate data from the Teradata databases.

Using tools such as Sqoop, Impala, or Teradata ETL, you will load huge volumes of data from Teradata into Hadoop cluster. You will then use Map/Reduce, Hive, Pig to process/analyze it and export aggregates back into Teradata for reporting.

Responsibilities:
We are looking for seasoned developers who thrive in a start-up environment. Qualified candidates are seasoned ETL and Tools developers who are accustomed to working across large independent databases and massive amounts of data. The Tools / ETL Developer will function as data expert to advise business analysts in the usage of structured and unstructured data.

• Experience developing, implementing, and refining data engineering solutions for huge volumes of data.
• Professional experience with Hadoop, Map/Reduce, Pig/Hive/Impala, Sqoop etc.
• Data Warehouse experience with Teradata, Oracle etc.
• Experience designing and implementing dimensional data models that scale across an enterprise business.
• Experience building scalable ELT/ETL workflows to transform and integrate data into structures conducive for reporting and analytics in Hadoop.
• Familiarity and experience in different phases of software development life cycle.
• Good understanding of algorithms, data structures, performance optimization techniques, and object-oriented programming
• Excellent communication, interpersonal, and problem-solving skills
• BS in Computer Science or equivalent

Bonus Points:

• MS or PhD in Computer Science
• Professional experience of ETL

All your information will be kept confidential according to EEO guidelines. If you meet the requirements of this unique opportunity, we encourage you to explore how you can make a difference by applying now.