Senior Azure Databricks Data Engineer​/Architect

Overview

Job Category: Data

Job Type: Remote

Job Location: New Jersey

Compensation: Depends on Experience

W2: W2-Contract Only; kindly note that applications on a C2C basis will not be considered for this role.

Eligible Visa: GC GC-EAD H4 EAD L2S U.S. Citizen (USC)

This position is open only to candidates authorized to work in the United States under the following visa categories:
H4-EAD, Green Card Holder, GC-EAD, U.S. Citizen, L2s, L2-EAD
. No other visa types are eligible for this role.

• Design and implement scalable data pipelines using Azure Databricks and Azure Data Factory.
• Develop and maintain robust ETL/ELT workflows using Apache Spark and PySpark Data Frames.
• Build and optimize data pipelines for efficient data ingestion, transformation, and processing of large datasets.
• Utilize data governance tools to manage data access, security, compliance, and data lifecycle.
• Implement data quality frameworks and maintain data lineage across enterprise data platforms.
• Design and support modern data architecture using Lakehouse and distributed data processing principles.
• Develop high-performance Spark and SQL-based data transformations.
• Apply Master Data Management (MDM) concepts to ensure data consistency, integrity, and standardization.
• Work within the Azure Databricks ecosystem to deliver scalable, reliable, and enterprise-grade data engineering solutions.

• Azure Databricks
• Apache Spark / Py Spark
• Azure Data Factory
• SQL
• Data Pipelines and ETL/ELT
• Data Governance and Data Lineage
• Lakehouse Architecture