Hadoop Platform Engineer

Location: Edinburgh or London (1–2 days per week on-site)

Contract- day rate

6 Month Contract

Our UK leading banking client is undergoing a major enterprise data transformation, and we’re looking for a skilled Hadoop Platform Engineer to help shape and evolve the future of our data ecosystem. If you’re passionate about data engineering at scale, modernisation, and cloud migration, this is a unique opportunity to work at the heart of one of the UK’s largest financial institutions.

As a Hadoop Platform Engineer, you’ll play a key role in supporting, maintaining, and modernising our on‑premise HDFS-based Data Lake and associated Hadoop ecosystem components. You will also help drive the strategic migration of our Hadoop workloads to the cloud, contributing to enterprise-wide simplification and transformation initiatives.

You’ll work across our data engineering community, ensuring our platforms remain robust, secure, and high‑performing as we transition to the next generation of data capabilities.

• Managing and maintaining large-scale Hadoop clusters across on‑prem environments
• Supporting and optimising our HDFS-based Data Lake and adjacent platform components
• Working with technologies including Hadoop, Spark, HDFS, YARN, Hive, Oozie
  , and related tooling
• Partnering with engineering teams to deliver scalable, high‑quality data solutions
• Contributing to our cloud migration strategy
  , helping move legacy workloads into modern cloud platforms
• Driving platform simplification and engineering excellence across distributed systems
• Supporting enterprise data transformation activities that enable the bank’s strategic objectives
• Ensuring stability, performance, and security of critical data services

• Strong hands‑on experience with Hadoop ecosystem tools (HDFS, Spark, Hive, Oozie, YARN, etc.)
• Experience operating and supporting large, complex, distributed clusters
• Understanding of data engineering principles and data platform design
• Experience with on‑prem Hadoop environments and ideally cloud‑based data platforms
• Exposure to cloud technologies (AWS, Azure, or GCP)
• Ability to troubleshoot complex platform issues across networking, compute, and storage layers
• A proactive mindset and desire to contribute to large‑scale transformation work
• Open to applicants from a variety of industries and backgrounds