Data Engineer – Intersystems to Cloud Migration; Snowflake​/Databricks

Data Engineer – Intersystems to Cloud Migration (Snowflake/Databricks)

Location:

Remote NYC

Contract:

Ongoing Contract-Part-time

Big Rio is a Boston-headquartered, remote-first technology consulting firm specializing in AI/ML, Cloud Transformation, Data Engineering, Healthcare Modernization, and Digital Innovation. We partner with leading healthcare, life sciences, and enterprise organizations to modernize legacy systems, build intelligent data platforms, and accelerate their path to AI-driven operations.

We are seeking a highly skilled Data Engineer with hands-on experience migrating data from Inter Systems to modern cloud data platforms, specifically Snowflake and Databricks. This role focuses on building secure, scalable pipelines to migrate large-volume datasets (5M+ records), including accurate de-identification of PHI, ensuring compliance with healthcare privacy standards.

You will be a core contributor to Big Rio’s cloud modernization solutions, working closely with internal stakeholders and client teams.

• Lead end-to-end migration of datasets from Inter Systems (Caché/IRIS) to Snowflake and Databricks within Big Rio’s cloud modernization framework.
• Build, optimize, and maintain large-scale ETL pipelines supporting 5M+ records with high performance and reliability.
• Implement PHI de-identification and masking processes aligned with HIPAA and Big Rio security best practices.
• Integrate data workflows with AWS RDS, Snowflake, and Databricks.
• Work with Big Rio’s architecture and AI engineering teams to support analytics, reporting, and ML/GenAI initiatives.
• Ensure data quality, monitoring, and validation throughout migration cycles.
• Maintain documentation of architecture, data lineage, transformation logic, and operational procedures.
• Collaborate with distributed Big Rio and client teams across the U.S. and India.

• 5+ years as a Data Engineer, with strong cloud engineering experience.
• Hands‑on expertise with Inter Systems (Caché/IRIS) – extraction, schema mapping, transformations.
• Strong experience building solutions with Snowflake and cloud‑native data warehousing.
• Expertise with Databricks, Spark, and PySpark for large‑scale processing.
• Proven ability to build and optimize ETL pipelines handling 5M+ record volumes.
• Strong understanding of PHI de‑identification, HIPAA compliance, and healthcare data workflows.
• Experience with AWS RDS, SQL, Python, and cloud orchestration tools.
• Strong foundation in data modeling, performance tuning, and scalable architecture.
• Excellent communication skills and comfortable working with global remote teams.

• Experience with HL7, FHIR, CCD, or healthcare data interoperability.
• Exposure to dbt, Airflow, Step Functions, or similar orchestration tools.
• Experience in healthcare data modernization or cloud migrations.

Mid‑Senior level

Part-time

Software Development

Referrals increase your chances of interviewing at Big Rio by 2x.