Software Quality Assurance Engineer - AI Agents
Listed on 2026-01-16
-
IT/Tech
AI Engineer, Data Scientist
Lucidya is a fast-growing SaaS company transforming customer experience across the MENA region through AI-powered solutions built for the Arabic-speaking world.
Our AI Agents business unit is focused on building and deploying intelligent, enterprise-grade AI agents that automate, assist, and augment customer-facing and operational workflows. These AI agents operate across complex environments (integrating with CX platforms, CRMs, contact centers, and internal systems) where reliability, accuracy, security, and trust are critical.
As we scale this new business unit, we are hiring a Software Quality Assurance Engineer to ensure our AI agents meet the highest standards of quality, performance, and enterprise readiness.
Why We’re Hiring
The AI Agents unit operates at the intersection of AI behavior, backend systems, APIs, and user experience
. Unlike traditional SaaS features, AI agents introduce new quality dimensions; such as consistency of responses, edge‑case handling, workflow reliability, and system resilience under real-world usage.
We need a QA Engineer who can:
- Own quality across AI‑driven workflows and agent‑based systems
- Balance manual, exploratory, and automated testing
- Validate complex backend and API integrations
- Help define quality standards for AI agent deployments at enterprise scale
- Partner with product, AI, data, and engineering teams early (“shift‑left”) to define acceptance criteria, test scenarios, and quality benchmarks for AI agents.
- Participate in requirement discussions to assess testability, risks, and edge cases specific to AI‑driven behavior.
- Help define what “good quality” means for AI agents (reliability, fallback behavior, latency, error handling, consistency).
- Execute manual and exploratory testing for AI agent workflows, integrations, and end‑to‑end scenarios.
- Validate agent behavior across happy paths, edge cases, failure states, and real‑world enterprise use cases.
- Conduct regression testing across multiple agents, channels, and environments.
- Validate cross‑browser and cross‑device behavior for agent‑facing UIs (web and mobile where applicable).
- Design, build, and maintain automated test suites (UI, API, end‑to‑end), with Playwright preferred
. - Extend automation frameworks to support agent workflows, conversational paths, and backend orchestration.
- Integrate automated tests into CI/CD pipelines and collaborate with Dev Ops to ensure reliable releases.
- Perform deep API and backend workflow testing to ensure AI agents interact correctly with internal and external systems.
- Support performance, load, and reliability testing—especially for concurrent agent usage and peak enterprise loads.
- Assist in security testing initiatives for AI agent integrations and data flows.
- Support test data strategies across environments, including realistic AI scenarios.
- Log, track, and triage defects; collaborate closely with engineers and AI teams to reproduce and resolve issues.
- Provide release readiness assessments, risk analysis, and defect trend reporting for agent deployments.
- Advocate for usability, accessibility, reliability, and enterprise‑grade quality across the AI Agents portfolio.
- Contribute to QA best practices, standards, and documentation tailored to AI agent systems.
- Help evolve testing approaches for AI‑driven products (e.g., exploratory heuristics, scenario‑based testing).
- Stay current with modern QA trends, including AI‑assisted testing, automation improvements, and cloud testing tools.
Solid manual and exploratory testing skills, strong defect analysis, and the ability to identify edge cases and risks.
Hands‑on experience building, maintaining, and troubleshooting automated tests (Playwright preferred).
Ability to test APIs and validate backend flows thoroughly.
Comfortable working across manual, automation, performance/security, requirement discussions, and…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).