Big Data Engineer

job summary:

Randstad Digital is hiring and we’re looking for someone like YOU to join our team! If you are seeking a new opportunity, looking to grow in your career, or you know someone who is – we want to hear from you! Take a look at the below opportunity, or feel free to visit  to view and apply.

location:
Charlotte, North Carolina

job type:
Contract

salary: $76.87 – 81.00 per hour

work hours: 8am to 5pm

education:
Bachelors

responsibilities:

Required Qualifications:

5 years of Big Data Engineer. As a Data Engineer , you will be responsible for designing, developing, and maintaining scalable data pipelines and robust ETL/ELT processes to support our enterprise analytics initiatives. Leveraging your expertise in Python and Py Spark , you will architect distributed data processing solutions within a Cloudera Hadoop ecosystem, ensuring high performance and reliability. You will take ownership of workflow orchestration using Apache Airflow to automate complex data life cycles and monitor pipeline health.

Beyond core engineering, you will collaborate with cross-functional teams to integrate data security best practices, where prior Infosec experience will be vital in safeguarding sensitive information. As we continue to evolve our infrastructure, you will play a key role in migrating or integrating workloads within Google Cloud Platform (Google Cloud Platform). Your mission is to transform raw, disparate data into high-quality, actionable datasets while maintaining the highest standards of data integrity and security.

qualifications:

Education:

Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related technical field.

Python Proficiency: 3 years of professional experience in Python development, specifically for data manipulation, automation, and API integrations.

Big Data Ecosystems:
Proven track record of building and optimizing “big data” data pipelines, architectures, and data sets using PySpark and Cloudera Hadoop (Hive, Impala, HDFS).

Workflow Orchestration:
Advanced experience with Apache Airflow for scheduling, monitoring, and managing complex DAGs (Directed Acyclic Graphs).

SQL Mastery:
Strong command of SQL for profiling data, performing complex joins, and tuning query performance in distributed environments.

Equal Opportunity

Employer:

Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

Pay offered to a successful candidate will be based on several factors including the candidate’s education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.