More jobs:
Data Engineer Spark Hadoop Apache Ozone Berkeley Heights NJ
Job in
Hanover Township, Morris County, New Jersey, USA
Listed on 2026-03-07
Listing for:
IPolarity LLC
Full Time
position Listed on 2026-03-07
Job specializations:
-
IT/Tech
Data Engineer, Big Data
Job Description & How to Apply Below
Data Engineer (Spark | Hadoop | Apache Ozone)
Berkeley Heights, NJ (Onsite)
Responsibilities:- Design and implement scalable distributed data processing solutions using Apache Spark and the Hadoop ecosystem.
- Build and maintain Spark applications for ETL, aggregation, and large-scale data transformation.
- Implement and manage enterprise data storage using Apache Ozone and HDFS.
- Develop batch and real-time ingestion pipelines using modern big data technologies.
- Optimize cluster performance, storage efficiency, and resource utilization.
- Ensure data quality, governance, security, and compliance across platforms.
- Troubleshoot performance issues across distributed environments.
- Collaborate with Data Scientists, Analysts, and Application teams to deliver reliable data solutions.
- Automate workflows and operational processes using scripting and orchestration tools.
- Strong experience with Apache Spark (Core, SQL, Streaming).
- Hands‑on expertise with Hadoop ecosystem (HDFS, YARN, Map Reduce).
- Experience working with Apache Ozone object storage.
- Programming skills in Python, Scala, or Java.
- Experience building scalable ETL/Data Pipelines.
- Knowledge of distributed systems and cluster optimization.
- Strong Linux/Unix and shell scripting experience.
- Understanding of data security, governance, and compliance practices.
Skills:
- Hive, HBase, or Kafka experience.
- Cloud-based big data platforms (AWS, Azure, or GCP).
- Containerization exposure (Docker, Kubernetes).
- CI/CD and automation for data engineering workflows.
- Bachelor’s degree in computer science, Software Engineering, or related field.
- Experience delivering enterprise data platform or product implementations preferred.
- Excellent communication and collaboration skills, and Strong problem-solving mindset and analytical thinking.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×