Data Engineer

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from TBG | The Bachrach Group

We are seeking a highly skilled Data Engineer to join our dynamic team. The ideal candidate will have strong experience in Data Engineering practices with expertise in Pentaho PDI, Airbyte, Power BI with DAX, Power Automate, Azure Administration, Python, API integration, SQL query optimization, data modeling, DBT, and Airflow orchestration. This role involves designing, developing, and maintaining data pipelines, optimizing performance, and ensuring the seamless flow of data across platforms.

Key Responsibilities:

• Implement ETL processes using Pentaho PDI and Airbyte for data ingestion and transformation.
• Develop and optimize SQL queries for performance improvement and efficient data retrieval.
• Build data models that support analytical and business intelligence (BI) needs.
• Develop reports and dashboards in Power BI, Paginated reporting, including advanced DAX calculations and visualization techniques.
• Automate workflows using Power Automate for data processing and reporting.
• Manage and maintain Azure infrastructure with hands-on experience in Azure Administration (security, monitoring, and performance tuning).
• Develop API, Python scripts for automation, data transformation, and analytics.
• Utilize DBT (Data Build Tool) for transformation and orchestration of ELT workflows.
• Implement Airflow for workflow orchestration and monitoring of data pipelines.
• Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver solutions.
• Ensure data quality, governance, and security across all data platforms.

Required Skills & Experience:

• 5+ years of experience as a Data Engineer working in Azure Cloud environments.
• Proficiency in ETL tools, particularly Pentaho PDI and Airbyte.
• Advanced SQL skills with a deep understanding of query optimization and performance tuning.
• Strong experience with Power BI, paginated report, including DAX and report development.
• Experience in workflow automation using Power Automate.
• Hands-on experience in Azure administration, including managing resources, security, and performance.
• Proficiency in Python for scripting, automation, and data manipulation.
• Experience with DBT (Data Build Tool) for data transformations.
• Hands-on experience with Apache Airflow for job orchestration.
• Strong understanding of data modeling concepts (dimensional modeling, star schema, snowflake schema).
• Excellent problem-solving skills and the ability to work in an agile environment.

Preferred Qualifications:

• Experience with Dev Ops practices for CI/CD in data engineering.
• Knowledge of Big Data technologies like Databricks or Spark.
• Experience in Finance and operational reporting.
• Experience with Data Governance & Compliance (GDPR, HIPAA, etc.)
• Previous experience in manufactured housing and property management is a plus.

• Seniority level
  
  Mid-Senior level

• Employment type
  
  Full-time

• Job function
  
  Information Technology
• Industries Technology, Information and Media

Referrals increase your chances of interviewing at TBG | The Bachrach Group by 2x

Medical insurance

Vision insurance

401(k)

Apply BELOW