Senior Data Engineer

Overview

This is an exciting opportunity to join a leading health data engineering team, based at GSTT, but operating across the wider region as part of the AI Centre for Value-Based Healthcare.

We are looking for a motivated individual with excellent data engineering skills, with enthusiasm and passion to learn.

The successful applicant will use a professional tool stack (including Snowflake, SQL, dbt, Python, and Natural Language Processing/Language AI tools) for building and orchestrating data pipelines, from source systems to analyst ready marts which will be used in clinical analytics, research, population health, and to support Real-World Data functions.

The postholder will work closely with a range of key stakeholders across GSTT and other NHS Trusts (including Lewisham and Greenwich, King’s College Hospital, and others).

• Proficient in SQL for data engineering and analytics
• Experience of using dbt
• Experience of EHR data and its meaning in clinical contexts
• Experience with best development practices, CI, and tools such as git

• Experience in Snowflake or other cloud platforms
• Proficiency in Python
• Experience of NLP / LLM usage in production settings
• Experience in data pipeline orchestration

In this role, you will be expected to develop modern data pipelines built to production standards (using Snowflake / SQL / dbt / Python) to harmonise data from highly complex transactional data, including from Cerner and Epic systems. You will be responsible for owning pipeline functions, and regularly engaging with data product end-users to update and improve functionality. Understanding of clinical data quality, best practices in testing and monitoring, and ability to build visualisation applications, are all highly desirable.

Your work will be the foundation for a wide variety of valuable use-cases, from clinical care to research, and from audit to innovation and AI projects.

You will have the opportunity to deploy Large Language Model and NLP tooling orchestration frameworks as part of standard data transformation pipelines, for extracting information from unstructured free text.

You will be supported in continuing your personal development within a friendly and highly expert team, particular in areas such as data orchestration, cloud infrastructure, and continuous integration/deployment. There will also be opportunity to mentor and supervise more junior technical staff.

The AI, Data & Digital Innovation directorate is made up of data and technology experts - based in GSTT but working closely as a team with KCH and KCL.

The team forms part of the Artificial Intelligence Centre for Value-Based Healthcare - a consortium of NHS, academic, and industry partners from across the UK. This consortium offers expert professional technical delivery across data engineering, data science & AI development, and software engineering. Programmes include region-wide infrastructure delivery of cloud and federated platforms, multi-modal Real-World Data engineering, foundation model development, and development of different Language AI solutions.

For further details / informal visits contact:
Name:
Joe Zhang

Job title:

CTO Email address: