More jobs:
Sr. Backend Software Engineer/Java/Python/API/CICD/A.I/RAG/RCA/Glendale
Job in
Burbank, Los Angeles County, California, 91520, USA
Listed on 2026-01-12
Listing for:
Motion Recruitment Partners, LLC
Part Time
position Listed on 2026-01-12
Job specializations:
-
IT/Tech
AI Engineer, Machine Learning/ ML Engineer
Job Description & How to Apply Below
Our client is one of the largest and well-known Theme parks and entertainment brands worldwide. They have an average of 200 million+ patrons yearly
They are looking for a contract Senior Backend Software engiineer. This is a hybrid role local to Burbank California. This role is supporting and acting as a shared service supporting Disney Marketing and titles development teams. This is a Senior Java Python, API, CI/CD and AI engineer will be working on applications for their theme parks.
This position is hybrid onsite 2-3 days a week in their Burbank location
Responsibilities- Work with product partners to design and run experiments for changes to models, prompts, content, retrieval strategies, guardrails, and other variables; track and report metrics using internal tooling and industry-standard AI observability platforms.
- Build or enhance tooling for content gap detection, retrieval diagnostics, prompt evaluation, and automated guardrails to minimize poor/unexpected outputs.
- Help define and monitor key KPIs (e.g., precision/recall, MRR/NDCG, answer accuracy, coverage, and latency) and maintain dashboards that reflect quality and reliability over time.
- Investigate and determine root cause for specific search and answer issues in partnership with product and operations (e.g., content gaps, retrieval/pipeline problems, prompt quality, code bugs, configuration or business rule errors).
- Implement fixes directly or coordinate with the appropriate engineering and content teams to mitigate issues and prevent regressions.
- Identify classes of issues, propose product improvements, and design technical solutions to improve relevance, answer quality, and recommendation performance at scale.
- Own triage in a hypercare role after releases: ensure issues are logged, prioritized, assigned, and driven to closure with clear communication and SLAs.
- Document findings, playbooks, and runbooks; create repeatable processes for RCA, experimentation, and hypercare operations.
- Strong software engineering skills in Java and Python, with experience building back-end services, APIs, pipelines, and integrations.
- Hands‑on experience with search technologies and Retrieval-Augmented Generation (RAG), including vector embeddings, chunking strategies, and prompt building.
- Practical knowledge of when and how to use LLMs to improve efficiency and quality, including prompt design/tuning, guardrails, and fallback strategies.
- Proven root cause analysis (RCA) capabilities: ability to trace issues across data, retrieval, prompts, models, and code; skilled at identifying patterns and proposing systemic fixes.
- Excellent communication, relationship‑building, and cross‑team coordination skills;
- comfortable serving as a liaison between product operations and engineering.
- Experience with experimentation frameworks and A/B testing, defining success metrics, and interpreting results to drive decisions.
- Familiarity with AI observability and monitoring tools for prompt/model performance, drift detection, and error tracking.
- Proficiency with CI/CD, version control, automated testing, and feature flagging.
- Strong bias for action; able to manage multiple priorities in a fast‑moving environment and follow through from issue detection to mitigation.
- Experience applying security best practices to application, system, and public cloud infrastructure.
- 60% Java / Python
- 20% CI/CD
- 40% AI tech development
- 65-85/hr
- available for W2 CT employee benefits
- 401k optional
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×