Data Engineer - NESO

About the role

National Energy System Operator’s (NESO) strength lies in our people. Together, we’re shaping the future where clean, affordable energy is accessible for all. Every day is an opportunity to make a real difference, accelerating the progress of sustainable GB energy, keeping people connected and society thriving as we create a brighter tomorrow.

As a key Data Engineer
, you will be instrumental in revolutionising how NESO's Electricity National Control Centre (ENCC) manages, validates, and leverages real-time operational data.

You will play a critical role in improving how we utilise data, ensuring access and data pipelines are accurate and reliable across the ENCC. This isn't just about data; it's about building the intelligent infrastructure that underpins a greener, more resilient energy system.

You will design and build robust new data connections, enabling NESO to operate a complex, decentralised, and renewable-heavy power system with unwavering confidence.

From developing end-to-end data pipelines and validation frameworks to implementing automation solutions, your work will ensure the accuracy, completeness, and timeliness of critical data – from telemetry and SCADA to market submissions and network parameters.

You’ll also be crucial in identifying gaps in our data needs and working with other teams to assess opportunities to strengthen the data foundation.

Furthermore, you will have significant scope to develop innovative data products by identifying and transforming legacy data, replacing outdated, manual processes with robust, automated solutions.

This role is a unique chance to embed powerful data engineering that eliminates manual errors and drives our digitalisation efforts forward, offering deep insights into real-time operations and the wider energy industry's challenges.

This role is based in Wokingham and we continue to offer hybrid working from office and home. We are open to full time and part time applicants, as well as flexible working arrangements.

• Pioneering Real-time Data Pipelines: Define and execute our data engineering strategy for the control room, designing, building, and maintaining operational data pipelines for real-time and near-time source systems.
• Innovating Data Products: Develop and implement automated rule-based data ingestion, cleaning, and validation systems.
• Fostering Leadership & Capability Development: Mentor and upskill junior colleagues, guide operational teams on effective data usage, and contribute to best-in-class data engineering standards and code modifications.

We are seeking a proactive, curious, and detail-oriented individual with a strong engineering mindset, ready to make their mark on the energy sector.

• A Master's or Bachelor's degree in Computer Science, Data Management, Systems Administration, or a related field, coupled with a of hands-on experience in data engineering.
• Strong experience with leading tools like Databricks, Spark, Kafka, Airflow, Azure Data Factory, or Kinesis.
• Proficient in Python and SQL
  , with a proven ability to build scalable batch and streaming pipelines.
• Experience with API integration, microservices, and robust data transformation frameworks.
• Deep understanding of data modelling (star schemas, entity modelling, event-driven architectures) and hands‑on experience with data validation frameworks and automated testing.
• Excellent problem‑solving skills
  , especially under pressure, with a commitment to continuous improvement.
• A natural collaborator, adept at working with both technical and non-technical stakeholders, and capable of influencing across engineering, markets, digital, and control operations.
• A genuine passion for establishing new capabilities, coupled with a key willingness to learn, particularly around operational and real‑time data.

Research shows that some people may hesitate to apply unless they meet every requirement. At NESO, we believe potential comes in many forms and we’re committed to a fair, inclusive recruitment process where everyone can show their talents. We celebrate the difference people can bring into our organisation, and welcome and encourage applicants with…