More jobs:
Big Data Hadoop Engineer - Onsite
Job in
Pleasanton, Alameda County, California, 94566, USA
Listed on 2026-02-28
Listing for:
INTELLISWIFT INC
Full Time
position Listed on 2026-02-28
Job specializations:
-
Software Development
Data Engineer
Job Description & How to Apply Below
Objective & Deliverables
The Big Data Engineer shall lead the Big Data Engineering team. The consultant will play the role of technical lead and provide professional services to support the long term IT strategy and planning to include high level analysis, professional reports and presentations, and mentoring, support and training.
Technical Knowledge andSkills:
- 4+ years of hands‑on Development, Deployment and production Support experience in Big Data environment.
- 4‑5 years of programming experience in Java, Scala, Python.
- Proficient in SQL and relational database design and methods for data retrieval.
- Knowledge of No
SQL systems like HBase or Cassandra. - Hands‑on experience in Cloudera Distribution 6.x.
- Hands‑on experience in creating, indexing Solr collections in Solr Cloud environment.
- Hands‑on experience building data pipelines using Hadoop components Sqoop, Hive, Solr, MR, Impala, Spark, Spark SQL.
- Must have experience with developing Hive QL, UDF's for analyzing semi‑structured/structured datasets.
- Must have experience with Spring framework, Web Services, REST API's and Micro Services.
- Hands‑on experience ingesting and processing various file formats like Avro/Parquet/Sequence Files/Text Files etc.
- Must have working experience in the data warehousing and Business Intelligence systems.
- Expertise in Unix/Linux environment in writing scripts and schedule/execute jobs.
- Successful track record of building automation scripts/code using Java, Bash, Python etc. and experience in production support issue resolution process.
- Experience in building Client models using MLLib or any Client tools.
- Hands‑on experience working in Real‑Time analytics like Spark/Kafka/Storm.
- Experience with Graph Databases like Neo4J, Tiger Graph, Orient DB.
- Agile development methodologies.
- 5+ years of strong hands‑on Design and Development experience in Hadoop/Big Data Environment.
- Strong hands‑on coding experience in Java, Scala and Python languages.
- Strong hands‑on experience with Spring framework, Web Services, REST API's and Micro Services.
- 3+ years of hands‑on experience building data pipelines using Hadoop components Sqoop, Kafka, Hive, SOLR, Map Reduce, Spark, Spark SQL, HBase etc.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×