Data Engineer - Informatica Powercenter, Python, SQL, CI​/CD

Data Engineer – Databricks & Python

Mississauga

4–6 years of professional experience in data engineering or data management

• Design, build, and maintain data pipelines using Databricks, PySpark, and Python

• Support data warehousing initiatives including data integration, transformation, and cleansing

• Develop and maintain data quality rules, validations, and mappings to ensure data accuracy and consistency

• Write and optimize complex SQL queries for data extraction, transformation, and analysis

• Troubleshoot and resolve data-related production issues
  , ensuring system stability and data integrity

• Work with cloud-based data platforms to support scalable data processing solutions

• Collaborate with cross-functional teams to follow software development lifecycle (SDLC) best practices

• Participate in Agile/Scrum ceremonies including sprint planning, stand-ups, and retrospectives

• Support CI/CD pipelines for data workloads and automation

• Provide ongoing operational support and continuous improvement of data systems

• 4–6 years of experience in data engineering, data management, or software development

• Strong experience with Databricks
  , Python
  , and Py Spark

• Proficiency in writing complex SQL

• Experience with
  data warehousing, data integration, and data cleansing

• Working knowledge of cloud technologies

• Experience troubleshooting data issues in Oracle and MS SQL environments (preferred)

• Familiarity with CI/CD pipelines and automation for data workflows

• Understanding of SDLC and Agile/Scrum methodologies

• Strong problem-solving skills and ability to work effectively in a team environment

• Experience with
  Perl

• Exposure to Dev Ops practices for data platforms

• Experience supporting production environments