Azure Data Engineer
Job in
Houston, Harris County, Texas, 77246, USA
Listed on 2026-01-14
Listing for:
New York Technology Partners
Full Time
position Listed on 2026-01-14
Job specializations:
-
IT/Tech
Data Engineer, Cloud Computing, Data Science Manager, Data Analyst
Job Description & How to Apply Below
Location: Hybrid – Houston, TX (Remote Dallas option with travel)
Azure Data EngineerWe are seeking an Azure Data Engineer to join a high-impact project modernizing business data into a cloud-native architecture. This role focuses on moving digitalized business data to a modern Azure structure to deliver BI insights, advanced analytics, and AI capabilities. You will be responsible for building complex, scalable end-to-end pipelines using Azure Data Factory (ADF) and Databricks
. The ideal candidate has deep experience in data ingestion, curation using Py Spark , and a background in Oil & Gas (O&G), specifically working with time-series data and real-time use cases.
- ADF Implementation: Design and develop end-to-end scalable pipelines in Azure Data Factory for seamless data ingestion into Azure Data Lake Storage (ADLS).
- Scalable ETL: Build and implement robust ETL processes to move data across environments while ensuring data integrity and high availability.
- Real-time Use Cases: Optimize pipelines to handle time-series data and support real-time analytics requirements.
- Data Curation: Build curated datasets within Databricks using Py Spark and SQL
, applying complex pivot logic and aggregations. - Advanced Analytics: Enhance data management by extracting data from multiple disparate sources and transforming it for downstream AI and BI consumption.
- Coding Mastery: Write complex SQL queries from scratch and develop reusable Python/PySpark scripts for data transformation.
- Cloud Modernization: Support the transition of legacy digital data to a modern cloud structure within the complete Azure ecosystem.
- Collaboration: Work closely with BI and AI teams to ensure curated data meets the requirements for advanced analytics and insights.
- Emerging Tech: Leverage or integrate with Microsoft Fabric (Nice to Have) to further streamline the data engineering workspace.
- Azure Data Factory: Experience with complex, scalable ingestion pipelines.
- Databricks: Expert-level PySpark, SQL, and curated dataset building.
- SQL: Proven ability to write high-performance queries from scratch.
Mid-Senior level
Employment typeContract
Job functionInformation Technology
IndustriesStaffing and Recruiting
#J-18808-LjbffrTo View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×