Senior Data Engineer

The Vulnerable People Statistics Team delivers insights that inform policy your will protect and support the most vulnerable in society. Central to this is the Homelessness Case Level Collection (H‑CLIC), a longitudinal dataset providing an unparalleled view of homelessness trends across England. This data underpins key publications, dashboards, and analysis that guide national policy and ministerial decisions.

As a Senior Data Engineer you will maintain and enhance the infrastructure powering H‑CLIC, manage the end‑to‑end quarterly production of homelessness statistics, maintain Power BI dashboards, automate pipelines, and develop visualisation tools to uncover insights and extend the reach of this flagship collection across government and society.

• Maintain and optimise the internal platform for our case‑level data collection and associated documentation.
• Lead data engineering and maintenance for H‑CLIC systems, a SQL‑based data infrastructure.
• Update and maintain Power BI dashboards to meet stakeholder needs.
• Support transition to API‑based data collections.
• Extract and prepare data from H‑CLIC systems for FOI and ad‑hoc requests.
• Mentor and task‑manage team members to build capability and resilience.

• Experience designing and optimising SQL queries, managing relational databases, and integrating them into efficient data workflows.
• Proficiency with Power BI and DAX: building and maintaining interactive dashboards, developing robust data models, and writing optimised DAX for large SQL datasets.
• Proven ability to automate data workflows from XML to SQL to Power BI, delivering streamlined and reliable reporting solutions.
• Experience in R and Python for data manipulation, statistical analysis, and visualisation, with Git for version control.
• Familiarity with data ethics, privacy and security frameworks, including anonymisation and responsible data use.
• Excellent communication skills and ability to lead technical discussions and clearly communicate complex concepts to non‑technical stakeholders.

• Salary band: £49,548–£60,110 (London) or £45,928–£56,630 (National); middle of the band if recruited.
• Digital allowance may be payable based on capability assessment.
• Pension:
  Civil Service Defined Benefit Pension scheme; the Ministry contributes £13,305 toward membership.
• Other benefits include tailored career pathways, flexible working, childcare voucher, Cycle‑to‑Work scheme, and more.

The Civil Service embraces diversity and promotes equal opportunities. We run a Disability Confident Scheme and offer a Redeployment Interview Scheme for at‑risk employees.