Azure Data Engineer

Roles & Responsibilities

Unified Analytics Platform

Must Have Technical/Functional

Skills:

• Synapse
• Fabric
• SQL Server
• Python
• Azure Storage
• ADF
• Power Bi

Work across Fabric workloads:
Data Factory (ETL), Synapse Data Engineering (Spark), Synapse Data Warehousing (SQL), and One Lake for storage.

Design data loading patterns, lakehouse architectures, and orchestration processes for enterprise-scale analytics.

Prepare and enrich data for analysis, ensuring data quality and consistency checks.

Implement semantic models for BI and self-service analytics.

Secure and manage analytics assets, enforce governance policies, and monitor compliance using Microsoft Purview and Managed Identity.

Monitor and optimize Fabric pipelines and workloads for cost efficiency and high availability.

Work closely with architects, analysts, and business teams to translate requirements into scalable solutions.

Enable Power BI integration for visualization and reporting.

Build and manage data pipelines using Azure Data Factory (ADF) and Synapse pipelines for batch and incremental ingestion.

Automate ETL workflows and implement parameterized pipelines for scalability.

Develop PySpark notebooks and SQL scripts to clean, transform, and convert raw files into optimized formats (Parquet/Delta).

Create views, stored procedures, and dimensional models for reporting and analytics.

Monitor Dynamic Management Views (DMVs) in Synapse to analyze system health and reduce bottlenecks.

Implement workload management strategies for query performance and resource governance.

Apply role-based authentication, encryption/decryption logic, and compliance controls.

Automate governance tasks to reduce manual intervention.

Build failure monitoring systems integrated with Logic Apps for alerting and proactive issue resolution.

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage:
  Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support:
  Maternal & Parental Leaves.
• Insurance Options:
  Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth:
  Commuter Benefits & Certification & Training Reimbursement.
• Time Off:
  Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance:
  Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Salary Range: $64,000-$100,000 a year

AMIE