Data Engineer
Listed on 2026-02-28
-
IT/Tech
Data Engineer, Big Data, Cloud Computing, Data Warehousing
Overview
In-depth knowledge of the Hadoop ecosystem, including HDFS, Map Reduce, Spark, Scala, Hive. Expertise in Hive for data warehousing and querying large datasets. Strong experience with Apache Spark for distributed data processing and real-time analytics. Advanced proficiency in Scala programming for big data application development. Familiarity with data modeling, ETL processes, and data integration techniques. Experience with cloud platforms and big data tools (e.g., Google Big Query).
Strong analytical and problem-solving skills to address complex data challenges. Basic knowledge on Java, Spring Boot. Architect and design scalable big data solutions leveraging technologies like Hadoop, Hive, Spark, and Scala. Develop and optimize data pipelines and workflows for processing and analyzing large-scale datasets. Manage and fine-tune distributed computing frameworks to ensure high performance and reliability. Collaborate with cross-functional teams, including data engineers, analysts, and business stakeholders, to gather and define data requirements.
Implement data security, governance, and compliance measures in big data environments. Diagnose and resolve technical issues in big data systems to maintain operational efficiency.
Job Title: Data Engineer
Location: Phoenix, AZ
Must Have Technical/Functional Skills- In-depth knowledge of the Hadoop ecosystem, including HDFS, Map Reduce, Spark, Scala, Hive
- Expertise in Hive for data warehousing and querying large datasets
- Strong experience with Apache Spark for distributed data processing and real-time analytics
- Advanced proficiency in Scala programming for big data application development
- Familiarity with data modeling, ETL processes, and data integration techniques
- Experience with cloud platforms and big data tools (e.g., Google Big Query)
- Strong analytical and problem-solving skills to address complex data challenges
- Basic knowledge on Java, Spring Boot
- Strong SQL skills
- Architect and design scalable big data solutions leveraging technologies like Hadoop, Hive, Spark, and Scala
- Develop and optimize data pipelines and workflows for processing and analyzing large-scale datasets
- Manage and fine-tune distributed computing frameworks to ensure high performance and reliability
- Collaborate with cross-functional teams, including data engineers, analysts, and business stakeholders, to gather and define data requirements
- Implement data security, governance, and compliance measures in big data environments
- Diagnose and resolve technical issues in big data systems to maintain operational efficiency
Salary Range: $105,000 to $120,000 per year
Qualifications: BACHELOR OF COMPUTER SCIENCE
#J-18808-Ljbffr(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).