Big Data Engineer Kafka

Job Description - Big Data Engineer with Kafka (CREQ
86827)

Job Description

Big Data Engineer with Kafka - ( CREQ
86827 )

Description

• Minimum 10+ years’ experience as a Bigdata engineer.
• Strong design, development and support experience on Big Data technologies including HIVE, HBase, Kafka, Spark Etc.
• High degree of proficiency in hands‑on low level design, coding, automation, troubleshooting
• Assemble large, complex data sets that meet functional / non‑functional business requirements
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re‑designing infrastructure for greater scalability, etc.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data‑related technical issues and support their data infrastructure needs.
• Working experience in banking domain and prior experience on L2 or L3 support is value add.

• Strong in at least one of the programming languages
  - Scala
  , Python , Java etc. and programming basics-Data structures
• Strong understanding and hands on experience in RDBMS and No
  
  SQL, SQL is mandatory
• Experience with big data tools
  - Hadoop,
  Spark
  , Kafka, Impala, Hive, HDFS and related tools
• Good handle on working in distributed computing and cloud services platform (AWS, Azure etc.)