ELT Engineer

Position Summary

The ETL Engineer is responsible for designing, developing, and maintaining data pipelines that extract, transform, and load data into analytics platforms, including SQL Server and Click House for real-time and high-performance querying. This role ensures data integrity, scalability, and performance for BI, reporting, and advanced analytics.

• ETL Pipeline Development
  • Design and implement ETL workflows using SQL Server Integration Services, Azure Data Factory, Databricks, and Click House.
  • Develop transformations for structured and semi-structured data; optimize for speed and reliability.
• Click House Integration
  • Build and maintain ingestion pipelines for Click House using batch and streaming methods.
  • Optimize Click House schemas, partitions, and materialized views for query performance.
• Data Integration
  • Connect multiple sources (SQL Server, APIs, cloud storage, Kafka/Event Hubs) into centralized data platforms.
• Performance & Optimization
  • Monitor SSIS ETL jobs and SQL Server and Click House queries; tune for low latency and high throughput.
  • Implement compression, sharding, and replication strategies in Click House.
• Data Quality & Governance
  • Apply validation checks, error handling, and lineage tracking.
  • Ensure compliance with security and governance standards.
• Collaboration
  • Work with data engineers, analysts, and BI teams to deliver reliable datasets.
  • Support real-time analytics and dashboards powered by Power
    
    BI and Click House.
• Documentation
  • Maintain clear documentation for ETL processes, SQL Server and Click House schemas, and operational playbooks.

• Strong experience with ETL tools (Azure Data Factory, SSIS, Databricks).
• Proficiency in SQL and relational database concepts.
• Familiarity with Click House (schema design, ingestion, optimization).
• Familiarity with cloud platforms (Azure preferred).
• Programming skills in Python or Scala for data processing.

• Experience with streaming data (Kafka, Azure Event Hubs).
• Familiarity with big data frameworks.
• Understanding of Dev Ops practices for data pipelines.
• Exposure to BI tools (Power BI, Tableau) integrated with Click House.

• Bachelor’s degree in Computer Science, Data Engineering, or related field.
• 3+ years of experience in ETL development and data integration.

Monday through Thursday (9-5) and remote on Fridays only (No exceptions).