More jobs:
AI Evaluation & Reliability Engineer
Job in
Redwood City, San Mateo County, California, 94061, USA
Listed on 2026-01-21
Listing for:
Saxon Global
Full Time
position Listed on 2026-01-21
Job specializations:
-
IT/Tech
Systems Engineer, Cloud Computing
Job Description & How to Apply Below
- 6+ years building evaluation or testing infrastructure for ML/LLM systems or large-scale distributes system
- Proven ability to translate product requirements into measurable metrics and test plans.
- Strong Python skills
- Strong Experience with modern data tooling
- Hands-on experience running A/B tests, canaries, or experiment frameworks.
- Experience defining and maintaining operational reliability metrics (SLIs/SLOs) for AI-driven systems.
- Familiarity with large-scale distributed or streaming systems serving AI/agent workflows (millions of events or alerts/day).
- Excellent communication skills -- able to clearly convey technical results and trade-offs to engineer, PMs, and analysts.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×