MLOps Tech Lead

Job Details Role /

Job Title:

MLOps Tech Lead

Work Location:

London, UK Office Requirement (Hybrid): 2 days per week

Key Responsibilities (High-Level) Data Pipeline Development:
Lead the technical direction of projects and ensure the use of Sainsbury's best practices to the best quality. Data Integration:
Lead and provide expertise on Integrate data from various sources, ensuring data consistency, integrity, and quality across the entire data lifecycle. Infrastructure Management:
Provide guidance for the junior & Mid Data Engineers on the best practices when building and managing data infrastructure, including data lakes, warehouses, and distributed processing systems (e.g., PySpark, Hadoop).

The Role As a Tech Lead , you will play a critical role in designing, building, and maintaining data pipelines and infrastructure that enable the development and deployment of machine learning models and drive engineering excellence. You will collaborate closely with data scientists, and lead ML engineers, and software engineers to ensure data is clean, accessible, and optimised for large-scale processing and analysis.

Your Responsibilities Data Pipeline Development:
Lead the technical direction of projects and ensure the use of Sainsbury's best practices to the best quality. Data Integration:
Lead and provide expertise on Integrate data from various sources, ensuring data consistency, integrity, and quality across the entire data lifecycle. Infrastructure Management:
Provide guidance for the junior & Mid Data Engineers on the best practices when building and managing data infrastructure, including data lakes, warehouses, and distributed processing systems (e.g., PySpark, Hadoop). Data Preparation:
Collaborate with data scientists to prepare and transform raw data into formats suitable for machine learning, including feature engineering and data augmentation. Automation:
Implement automation tools and frameworks (CI/CD) to streamline the deployment and monitoring of machine learning models in production. Performance Optimisation:
Optimise data processing workflows and storage solutions to improve performance and reduce costs.

Collaboration:

Work closely with cross-functional teams, including data science, engineering, and product management, to deliver data solutions that meet business needs. Mentorship: junior and mid-level data engineers and provide technical guidance on best practices and emerging technologies in data engineering and machine learning and helping to enhance their skills and career growth. Knowledge Sharing and Empowerment:
Promote a culture of knowledge sharing within the engineering teams by organising regular technical workshops, brown bag sessions, and code reviews. Innovation and Continuous Improvement:
Foster a collaborative and inclusive team environment that encourages continuous learning and improvement. Your Profile Essential Skills / Knowledge / Experience Knowledge of machine learning frameworks (e.g., PySpark, PyTorch) and model deployment tools (e.g., MLflow, Tensor Flow Serving). Strong experience with data processing frameworks (e.g., Apache Spark, Flink). Expertise in SQL and No

SQL databases (e.g., MySQL, Postgre

SQL, Mongo

DB, Cassandra). Hands-on experience with cloud platforms (e.g., AWS, GCP, Azure) and their data services (e.g., Snowflake, S3, Big Query, Redshift).

Experience with containerisation and orchestration tools (e.g., Docker, Kubernetes). Familiarity with version control systems (e.g., Git) and CI/CD pipelines. Desirable Skills / Knowledge / Experience

Certifications:

AWS Certified Big Data Specialty, Google Professional Data Engineer, or equivalent.

Soft Skills:

o Excellent problem-solving and analytical skills. o Strong communication skills, with the ability to explain complex technical concepts to non-technical stakeholders. o Ability to work independently and in a team-oriented, collaborative environment. Leadership and Communication Strong leadership skills with the ability to inspire and guide team. Lead scrum ceremonies as and when needed (Standup, Planning, and grooming sessions). Excellent verbal and written communication skills, with the ability to…