Product Quality Evaluator - Mobile

Location:
Hybrid 2-3 a week – In office Sunnyvale or Omaha, NE

Contract: 6 months

Job Description:

This role will support the Product Quality Evaluator (PQE) team. You’ll work on client’s core products helping to identify, prioritize, and onboard key user flows for agentic automation. You will evaluate the product quality of new and nuanced client products and features by independently and comprehensively testing user flows and functionalities and triaging agentic identified issues.

• Identify, evaluate, and onboard user test flows into an agentic test automation platform.
• Review DOM structures and validate tracking event implementations across web applications.
• Validate agentic automation results (pass/fail), investigate failures, and ensure accuracy of outcomes.
• Collaborate with engineers, technical leads, and product managers to prioritize user flows and test cases for agentic automation.
• Partner closely with engineering teams to identify, report, and verify defects; confirm fixes and provide sign‑off verification.
• Author, execute, and maintain high‑quality test cases based on product specifications and real member behaviour.
• Maintain the test case repository as the source of truth for expected product behaviour and test coverage.
• Analyze issues reported by test agents and recommend improvements to testing tools, frameworks, and workflows.
• Estimate level of effort, balance competing priorities, and manage multiple projects in parallel.
• Present technical and functional findings to senior leadership, including both technical and non‑technical stakeholders, and provide recommendations on product readiness for public launch.

• 2+ years of experience in one or more of the following:
  User Testing, Product Evaluation, Quality Assurance, User Experience, or Test Engineering.

• Experience working in Agile testing environments.
• Hands‑on experience with JIRA and Test Rail (or similar tools).
• Proven experience writing test plans and detailed test cases.
• High attention to detail with the ability to manage multiple, competing priorities effectively.

• Experience with Appium for mobile automation testing.
• Experience testing APIs using tools such as Postman.
• Experience working on AI‑driven products or features, or a strong interest in AI technologies.