Data Engineer

We are seeking a highly experienced Data Engineer with over 12 years of experience to design and implement scalable data solutions.

The ideal candidate will have deep expertise in data engineering languages, cloud data platforms, big data processing frameworks, and orchestration tools.

This role requires strong problem-solving skills, a solid understanding of data modeling, and a passion for building robust data pipelines in cloud-native environments.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL processes.
• Work with structured and unstructured data using modern data engineering tools and frameworks.
• Implement data processing solutions using batch, micro-batching, and streaming methodologies.
• Collaborate with cross-functional teams to define data architecture and modeling strategies.
• Ensure data quality, consistency, and governance across platforms.
• Develop and maintain CI/CD pipelines and follow TDD/BDD practices.
• Document technical solutions and maintain clear, comprehensive records.

• 12+ years of overall experience in data engineering or related fields.
• Proficiency in Python (preferred), or Scala/Java.
• Experience with cluster computing frameworks such as Spark (preferred), Flink, or Storm.
• Hands-on experience with cloud data lakehouse platforms (preferably AWS or Databricks).
• Proficiency with relational databases (e.g., Postgres, Oracle) and No
  
  SQL databases (e.g., Cassandra, Dynamo
  
  DB, Mongo
  
  DB).
• Experience with orchestration tools such as Airflow (preferred) or AWS Step Functions.
• Strong understanding of data structures, serialization formats (JSON, AVRO, Protobuf), and big data storage formats (Parquet, Iceberg).
• Familiarity with data modeling techniques (Dimensional, Data Vault, Kimball, Inmon).
• Experience with Agile methodologies, CI/CD tools (e.g., Jenkins, Git), and TDD/BDD practices.
• Excellent organizational, documentation, and critical thinking skills.

• Experience using AWS Bedrock APIs.
• Knowledge of Generative AI concepts (e.g., RAG, vector embeddings, model fine-tuning, agentic AI).
• Experience with Infrastructure as Code (IaC) tools such as Terraform (preferred) or AWS Cloud Formation.