Azure Data Engineer - ETL Ontario, CA

Position: Azure Data Engineer - ETL at Cleo Consulting Ontario, CA

Azure Data Engineer - ETL job at Cleo Consulting. Ontario, CA.

Assignment: RQ10371 - Software Developer - ETL - Senior

Job Title:

Azure Data Engineer - ETL

Requisition (SS): RQ10371

Start Date:

Client:
Health Services Cluster End Date:  Office

Location:

5700 Yonge Street, Toronto Organization:
Health Services Cluster Ministry:
Ministry of Public and Business Service Delivery and Procurement # Business Days: 250.00 Assignment Type:
This position is listed as Onsite; the resource is expected to work 7.25 hours per calendar day between the standard working hours of 8:00-5:00 PM (excluding lunch breaks) every Monday to Friday inclusive at the identified OPS office location. MUST HAVES:

• Please refer to the Technical Skills in the Experience and Skill Set Requirements

Description

• Design technical solutions for data acquisition and storage into our centralized data repository.
• Develop ELT scripts, design data-driven logic and conduct unit testing.
• Conduct database modeling and design as to improve overall performance.
• Produce design artifacts and documentation which will allow future support of the implemented solutions.
• Investigate and resolve incidents and identify whether the problem is caused by the data loading code or is due to bad data received from the data provider.
• Execute service requests related to routine and ad-hoc data loads.
• Provide the data quality check and report on the data quality issue.

NOTE

• Extension/Amendment Attestation:
  Extension(s) only allowed using unused days/funds left on contract. No additional funds will be added beyond the maximum contract value and any extension options included in the original SOW.
• Assignment Type:
  This position is listed as Onsite; the resource is expected to work 7.25 hours per calendar day between the standard working hours of 8:00-5:00 PM (excluding lunch breaks) every Monday to Friday inclusive at the identified OPS office location.

Experience and Skill Set Requirements Technical Skills - 50 points

• 10+ years experience in:
• Designing and developing scalable Medallion Data Lakehouse architectures.
• Expertise in data ingestion, transformation, and curation using Delta Lake and Databricks.
• Experience integrating structured and unstructured data sources into star/snowflake schemas.
• Building, automating, and optimizing complex ETL/ELT pipelines using Azure Data Factory (ADF), Databricks (PySpark, SQL, Delta Live Tables), and dbt.
• Implementing orchestrated workflows and job scheduling in Azure environments.
• Strong knowledge of relational (SQL Server, Synapse, Postgre
  
  SQL) and dimensional modeling.
• Advanced SQL query optimization, indexing, partitioning, and data replication strategies.
• Experience with Apache Spark, Delta Lake, and distributed computing frameworks in Azure Databricks.
• Working with Parquet, ORC, and JSON formats for optimized storage and retrieval.
• Deep expertise in Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Azure SQL, Event Hubs, and Azure Functions.
• Strong understanding of cloud security, RBAC, and data governance.
• Proficiency in Python (PySpark), SQL, and Power Shell for data engineering workflows.
• Experience with CI/CD automation (Azure Dev Ops, Git Hub Actions) for data pipelines.
• Implementing data lineage, cataloging, metadata management, and data quality frameworks.
• Experience with Unity Catalog for managing permissions in Databricks environments.
• Expertise in Power BI (DAX, data modeling, performance tuning).
• Experience in integrating Power BI with Azure Synapse and Databricks SQL Warehouses.
• Familiarity with MLflow, AutoML, and embedding AI-driven insights into data pipelines.

Core Skill and Experience - 30 points

• 10+ years of experience with technical systems specifications and translating them into working, tested applications for large, complex, mission critical applications.
• 10+ years of experience in technical analysis, program code, detailed programming and reports specifications, program design, writing and /or generating code, and conducting unit tests.
• 10+ years of experience in software in various computing platforms, operating systems, database technology, communication protocols, middleware and gateways.
• 10+ years of experience in developing and maintaining system design models, technical documentation, and specifications.
• 5+ years of experience in conducting technical evaluation and assessment of options for technical design issues, application figuration aspects and integration capabilities, related tools and utilities, gap analysis of integration components to technical requirements / specifications / documentation.
• SDLC end-to-end.

General Skills - 15 points

• Demonstrated strong leadership and people management skills.
• Proven technical leadership skills with ability to identify areas for improvement, and recommend solutions.
• Exceptional analytical, problem solving and decision-making skills.
• Demonstrated strong interpersonal, verbal and written communication, and presentation skills.
• Proven troubleshooting and critical thinking experience
• Demonstrated ability to…