Data Architect

Job Title:

Data Architect
Exp Range: 12 - 18

Job Location:

Kolkata Only

Job Description:

Required skill:
Databricks, AWS ,Redshift

EDW DB to Databricks Lakehouse Platform on AWS
12+ years with 4-5+ years in Cloud Data Architecture, Databricks and AWS

1. 12+ years with 4-5+ years in Cloud Data Architecture, Databricks and AWS

2. Should have experience of migration of an enterprise data warehouse from AWS Redshift/RDS or any other EDW DB to Databricks Lakehouse Platform on AWS. Conversant with cloud-native architectures, Databricks platform capabilities and modern data Lakehouse design patters. Can able to own end-to-end architecture, including migration strategy, data modeling, governance and performance optimization.

3.

Key Responsibilities:

a) Architecture & Strategy:
Define target architecture, conduct gap analysis, design data Ingestion, storage, transformation and consumption layer using delta lake along with Databricks best practices

b) Data Modeling & Design:
Translate existing DWH/DB star/srowflake schemas into Databricks-optimized Delta Lake models, implement SCD, fact/dimension modeling, ACID compliance, partitioning etc.

c) Governance, Security & Compliance:
Implement data governance, cataloging, lineage using Unity Catalog and AWS Glue; define RBAC, data masking, encryption, etc.

d) Migration Execution Oversight:
Work with DEV team for SQL-to-Spark migration; oversee data validation & reconciliation; work with Dev Ops team to design CI/CD pipelines for Databricks jobs, etc