Starburst Data Engineer

Job Description

Location:

Charlotte, NC;
Plano, TX;

Primary Skill:
Starburst

Secondary:
Data Virtualization Engineer, Dremio, Presto, SQL Performance Tuning, Shell Scripting, Autosys

Experience:

Minimum 10 years

• Demonstrated expertise in Starburst Data Virtualization, including designing and implementing data virtualization solutions, optimizing query performance across distributed data sources, and integrating Starburst with enterprise data architectures.
• Analyze data mapping documents and business requirements to design comprehensive test plans and cases.
• Perform source-to-target data reconciliation, check data loading, and ensure transformation rules are applied correctly.
• Write complex SQL scripts for validation (count, data completeness, data consistency, data truncation).
• Identify, log, and track data defects using tools like JIRA or HP ALM or Octane.
• Automate test scripts and validate data volume, performance, and scalability.
• Expert-level knowledge of SQL for data analysis.
• Experience with tools such as Informatica and IDMC.
• Understanding of data warehouse concepts and architectures (e.g., star/snowflake schema).
• Familiarity with Hadoop or Spark is often preferred.
• Validate HiveQL, HDFS file structures, and data processing within the Hadoop cluster.
• Strong analytical and troubleshooting skills.
• Excellent communication for collaborating with developers and stakeholders.

Starburst, IDMC, Informatica Power center, Hive, Kafka Knowledge

SQL, Oracle, PL/SQL

Domain:
Banking knowledge, Payments knowledge preferred.

Concept:
Data Virtualization, Data Warehousing, Data Transformation, ETL/ELT, Data Quality.

Salary :,000/Per Annum