Lead Site Reliability Engineer - DataOps

Lead Site Reliability Engineer - Data Ops

Join to apply for the Lead Site Reliability Engineer - Data Ops role at Capital One

Nottingham Trent House (95002), United Kingdom, Nottingham, Nottinghamshire

We are seeking a Lead Site Reliability Engineer (Data Ops) to lead the charge on ensuring the health, reliability, and security of our critical data pipelines. This senior, hands‑on technical role is for an expert comfortable with mission‑critical batch data pipelines in a cloud environment, integrating with numerous real‑time data sources.

• Production Support & Reliability:
  Act as the subject matter expert and technical lead for resolving the most complex, high‑impact incidents affecting data pipelines. Manage multiple stakeholders for critical events. Perform in-depth root cause analysis to prevent recurrence, focusing on data pipelines, scheduling platforms such as Control‑M and AWS‑related services.
• Data Security & Governance:
  Ensure the integrity and security of highly sensitive and critical data throughout the entire pipeline. Implement and enforce security best practices, including managing encryption at rest and in transit, access controls, and compliance.
• Automation & Tooling:
  Develop and implement automation for common operational tasks to reduce manual toil. Focus on building tools and monitoring solutions that provide visibility into the end‑to‑end health of pipelines.
• Performance Optimization:
  Proactively analyse and tune the performance of batch schedules and AWS resource utilisation. Identify and implement optimisations to improve efficiency and reduce operational costs.
• Collaboration & Leadership:
  Act as a technical leader and mentor for both onsite and offshore team members. Ensure seamless collaboration, clear communication, and consistent operational standards across a distributed team. Contribute to the long‑term technical strategy for data operations including modernisation efforts.

• Demonstrable hands‑on experience in a production support, site reliability, or data operations role within a large‑scale data environment.
• Experience with data distribution platforms (e.g. Ab Initio & Spark centric solutions like AWS Glue & EMR), including deep understanding of ETL/ELT workflows & integration into data platforms like Snowflake.
• Extensive experience with scheduling platforms such as Control‑M, including complex scheduling, dependencies, and managing a large batch environment.
• Working knowledge of IBM Sterling File Gateway or similar file transfer (MFT) solutions would be beneficial (e.g. AWS Transfer Family).
• Deep knowledge of AWS and its data‑related services, including knowledge of open‑source, cloud‑first data‑pipeline orchestration capabilities like Apache Airflow.
• Proficiency in Shell scripting & Python for automation and system administration.
• Proven ability to manage highly sensitive and critical data pipelines, with a strong understanding of security and compliance requirements.
• Demonstrated experience working effectively with both onsite and offshore teams, ensuring seamless operational handoffs and knowledge sharing.
• Excellent communication skills, with the ability to articulate complex technical issues to both technical teams and business stakeholders.
• Experience with Dev Ops or Data Ops principles and practices is essential.

This is a permanent position and is based in our Nottingham office. We have a hybrid working model which gives you flexibility to work from our offices and from home. We’re big on collaboration and connection, so you’ll be based in our office 3 days a week on Tuesdays, Wednesdays and Thursdays.

What’s in it for you

• Bring us all this and you’ll be rewarded with a role contributing to the product roadmap for an organisation committed to transformation
• We’re continuing our journey into the public cloud and have problems of scale, security, availability and performance for you to help solve
• We offer high performers strong and diverse career progression, investing heavily in developing great people through our Capital One University training programmes (and appropriate external providers)
• Immediate access to our core benefits including pension scheme, bonus, generous…