Data Engineer

Job Description

We are seeking an experienced Data Engineer with deep expertise in enterprise-scale metadata management platforms, data governance frameworks, and AI-ready infrastructure design. This role will architect and optimize a Redshift-centric data ecosystem leveraging AWS native services to enable robust metadata management, data lineage, and governance capabilities that support both operational analytics and future AI/ML workloads.

• Design and implement scalable metadata management infrastructure using AWS Glue Data Catalog, Redshift Spectrum, and Lake Formation.
• Develop and maintain data lineage systems, ensuring transparency and traceability across complex data flows.
• Manage schema evolution and orchestrate cross-system data mapping for diverse data sources.
• Establish and enforce data governance policies, including compliance, security, and discoverability standards.
• Automate metadata ingestion and implement data quality frameworks to ensure accuracy and consistency.
• Architect infrastructure that supports AI/ML readiness through advanced tagging, cataloging, and governance protocols.
• Collaborate with cross-functional teams to integrate metadata solutions into enterprise data platforms.
• Optimize performance and scalability of AWS-based data ecosystems for large-scale analytics.

• AWS Glue Data Catalog
• Redshift Spectrum
• Lake Formation

• Enterprise-scale metadata platforms
• Automated metadata ingestion

• Framework design and implementation
• Compliance and security protocols

• Redshift-centric ecosystems
• Schema evolution and versioning
• Cross-system data mapping

• Design and deployment of lineage tracking systems

• Frameworks for validation and consistency

• Infrastructure design for future AI workloads
• Advanced tagging and cataloging strategies

• Proficiency in Python, SQL
• Familiarity with ETL orchestration tools (e.g., AWS Glue, Apache Airflow)

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances.

If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to  To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: