Scala Spark Developer

Location: Bengaluru

Job Description:

5 years of in depth hands on experience of developing testing deployment and debugging of Spark Jobs using Scala in Hadoop Platform
In depth knowledge of Spark Core working with RDDs Spark SQL
In depth knowledge on Spark Optimization Techniques and Best practices
Good Knowledge of Scala Functional Programming Try Option Future Collections
Good Knowledge of Scala OOPS Classes Traits and Objects Singleton and Companion Case Classes
Good Understanding of Scala Language Features Type System Implicit Givens
Hands on experience of working in Hadoop Environment HDFS Hive AWS S3 EMR

Working experience on Workflow Orchestration tools like Airflow Oozie
Working with API calls in Scala
Understanding and exposure to file formats such as Apache AVRO Parquet JSON
Good to have knowledge of Protocol Buffers and Geospatial data analytics
Writing Test cases using frameworks such as scalatest
Good Knowledge of Build Tools such as Gradle SBT in depth
Experience on using GIT resolving conflicts working with branches
Good to have Python programming skills
Good to have worked on some workflow systems as Airflow
Strong programming skills using data structures and algorithms
Excellent analytical skills
Good communication skills

Key Responsibilities:

5 years of in depth hands on experience of developing testing deployment and debugging of Spark Jobs using Scala in Hadoop Platform
In depth knowledge of Spark Core working with RDDs Spark SQL
In depth knowledge on Spark Optimization Techniques and Best practices
Good Knowledge of Scala Functional Programming Try Option Future Collections
Good Knowledge of Scala OOPS Classes Traits and Objects Singleton and Companion Case Classes
Good Understanding of Scala Language Features Type System Implicit Givens
Hands on experience of working in Hadoop Environment HDFS Hive AWS S3 EMR

Working experience on Workflow Orchestration tools like Airflow Oozie
Working with API calls in Scala
Understanding and exposure to file formats such as Apache AVRO Parquet JSON
Good to have knowledge of Protocol Buffers and Geospatial data analytics
Writing Test cases using frameworks such as scalatest
Good Knowledge of Build Tools such as Gradle SBT in depth
Experience on using GIT resolving conflicts working with branches
Good to have Python programming skills
Good to have worked on some workflow systems as Airflow
Strong programming skills using data structures and algorithms
Excellent analytical skills
Good communication skills
Technical Requirements:
Primary skills Technology Big Data Data Processing Spark Technology Cloud Platform Amazon Webservices Dev Ops Technology Finacle Core Ops Multi Entity Advance Technology Functional Programming Scala
Additional Responsibilities:
Ability to work with clients to identify business challenges and contribute to client deliverables by refining analyzing and structuring relevant data
Awareness of latest technologies and trends
Logical thinking and problem solving skills along with an ability to collaborate
Ability to assess the current processes identify improvement areas and suggest the technology solutions
One or two industry domain knowledge
Preferred

Skills:

Bigdata->Pyspark,Bigdata->Python,Bigdata->Scala,Bigdata->Spark,Opensource->Apache Kafka