Data Engineer Job Chicago area,Illinois USA,IT/Tech

Education: Bachelor's degree in Computer Science or related field.

Posted Date: 09/02/2026

Tentative Project

Start Date:

Immediate

Job Summary

Seeking a Data Engineer to collaborate with Data Science teams, integrate machine learning models into the enterprise data platform, and support the full lifecycle of data pipelines. This role focuses on model implementation, workflow orchestration, data quality validation, and production deployment using modern cloud technologies and Agile methodologies.

Key Responsibilities

Collaborate closely with Data Science teams to receive insurance-related analytical and predictive models, understand business requirements, model logic, and expected outcomes prior to implementation.

Review and refactor DS-provided model code to remove hardcoded values and environment-specific logic, and parameterize configurations using Python, SQL, and shell scripting for portability and scalability.

Standardize model inputs, configuration parameters, and execution workflows to ensure consistent behavior across development, testing, and production environments.

Integrate validated Data Science models into the GBD (Global Business Data) enterprise data platform, ensuring adherence to data architecture, security, and governance standards.

Design, develop, and maintain Apache Airflow DAGs to orchestrate data pipelines, model execution schedules, and upstream/downstream dependencies.

Support model lifecycle management and experimentation using Kubeflow, enabling reproducible, version-controlled, and scalable machine learning workflows.

Perform end-to-end model testing and validation using enterprise datasets stored in AWS S3 and processed via AWS EMR and AWS Glue, ensuring data accuracy, performance, and reliability.

Conduct data quality checks, output validation, reconciliation, and performance analysis, and document results for Data Science review and approval.

Collaborate with Data Science teams during validation cycles, address feedback, resolve issues, and finalize model implementations prior to production release.

Prepare and deploy approved models into production environments, following established release management and change control processes.

Deploy, monitor, and support production workflows using AWS services including EC2 instances, Lambda functions, S3 buckets, and Glue jobs.

Track development tasks, enhancements, defects, and production issues using Jira, ensuring timely resolution and transparent communication across teams.

Troubleshoot pipeline failures, model execution issues, and infrastructure‑related incidents, and implement corrective actions to maintain system stability.

Use VS Code for development and debugging, Bitbucket for version control and code reviews, Confluence for documentation, and Jira for Agile project tracking and sprint management.

Participate in Agile ceremonies such as sprint planning, stand‑ups, and retrospectives, providing technical updates and supporting cross‑functional collaboration.

Required

Skills and Qualifications

Minimum 3 years of relevant experience in data engineering.
Strong proficiency in Python, SQL, and shell scripting.
Experience with Apache Airflow for workflow orchestration.
Knowledge of Kubeflow for machine learning lifecycle management.
Hands‑on experience with AWS services (S3, EMR, Glue, EC2, Lambda).
Experience with data quality validation and testing frameworks.
Proficiency in VS Code, Bitbucket, Confluence, and Jira.
Understanding of data architecture, security, and governance principles.
Experience with Agile methodologies and ceremonies.
Strong problem‑solving and troubleshooting skills.
Excellent collaboration and communication abilities.

Preferred Qualifications

Experience working with Data Science teams and machine learning models.
Proven track record of deploying and maintaining production data pipelines.
Experience in the insurance or financial services domain is a plus.

E-Verify® is a registered trademark of the U.S. Department of Homeland Security.

#J-18808-Ljbffr


Increase/decrease your Search Radius (miles)



Job Posting Language