AWS Data Engineer – Python, Pyspark, EMR, Spark, Kafka​/Kinesis, SQL​/NoSQL

As a Data Engineer with deep expertise in Python, Pyspark, AWS, big data ecosystems, and SQL/No

SQL technologies, driving scalable, real‑time data solutions with CI/CD and stream‑processing frameworks.

Experience: –8+ Years

Contract

In‑person Interview Required

Location: –Chicago, IL (Local Only)

Educational

Qualifications:

–

• Engineering Degree BE/ME/BTech/MTech/BSc/MSc.
• Technical certification in multiple technologies is desirable.

Mandatory skills: –

• Python, PySpark, AWS

Good to have skills: –

• EMR, Spark, Kafka/ Kinesis

Responsibilities: –

• Proficient developer in multiple languages, Python is a must, with the ability to quickly learn new ones.
• Expertise in SQL (complex queries, relational databases preferably Postgre
  
  SQL, and No
  
  SQL database – Redis and Elasticsearch).
• Extensive big data experience, including EMR, Spark, Kafka/ Kinesis, and optimizing data pipelines, architectures, and datasets.
• AWS expert with hands‑on experience in Lambda, Glue, Athena, Kinesis, IAM, EMR/PySpark, Docker,
• Proficient in CI/CD development using Git, Terraform, and agile methodologies.
• Comfortable with stream‑processing systems (Storm, Spark‑Streaming) and workflow management tools (Airflow).
• Exposure to knowledge graph technologies (Graph DB, OWL, SPARQL) is a plus.