Agentic AI Benchmarking and Evaluation Engineer

Company

Qualcomm Technologies, Inc.

Engineering Group, Machine Learning Engineering

Qualcomm AI Research looking for talented ML/AI algorithm evaluation engineers with experience in machine learning to enable embedded GenAI and Agentic AI.

Come join a high-caliber team of engineers building advanced machine learning technology, best‑in‑class solutions, tools such as AI Model Efficiency Toolkit, and others to enable state‑of‑the‑art networks/systems to run on devices with limited power, memory, and computation.

Join Qualcomm’s AI Research team to design and implement highly optimized machine learning solutions for generative AI, in collaboration with a multi-disciplinary team of researchers and engineers.

• Work with world‑class engineers at Qualcomm Research to evaluate ML software tools and algorithms to ensure they meet quality standards, including developing evaluation strategy and KPIs.
• Port AI/ML solutions to various platforms and optimize performance on multiple hardware accelerators (CPU/GPU/NPU).
• Collaborate with software teams to implement evaluation strategy, decide KPIs, develop automation, and perform qualitative tests.
• Develop a deep understanding of ML algorithms, apply tools on various use cases, develop best practices, provide detailed analysis, extend research, and identify areas for optimization.
• Perform in‑depth benchmarking and model evaluation to ensure AI systems meet safety standards.

• Exceptional software development skills with excellent analytical, development, and debugging skills.
• Strong understanding of Machine Learning fundamentals.
• Understanding of generative AI and its usage in various applications.
• Experience with LLM, LVM, LMM models, and other NN architectures.
• Proficiency in designing, implementing, and training ML algorithms in high‑level languages/frameworks such as PyTorch and Tensor Flow.
• Excellent interpersonal, written, and oral communications skills.

• MS or PhD in Computer Science/Engineering with 5+ years of professional experience or equivalent experience.
• 5+ years of proven experience in software development for GenAI, machine learning or high‑performance computing with strong programming skills in Python and software design.
• Familiarity with AI agent frameworks (e.g., Lang Chain, Llama Index, Autogen).
• Experience using/integrating Qualcomm AI Stack products (e.g., QNN, SNPE, QAIRT).
• Experience with machine learning accelerators, optimizing algorithms for hardware acceleration cores, working with heterogeneous or parallel computing systems.
• Experience driving cross‑functional projects, including close collaboration with AI application teams to translate product needs into evaluation frameworks.
• Design and develop generalized AI solutions, including RAG systems, to enhance user capabilities with our AI accelerators.
• Experience in Android/Linux or other embedded systems.

• Bachelor's degree in Computer Science, Engineering, Information Systems, or related field and 4+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
• Master's degree in Computer Science, Engineering, Information Systems, or related field and 3+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
• PhD in Computer Science, Engineering, Information Systems, or related field and 2+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.

Qualcomm is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other protected classification.

Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other proprietary information.

$ – $

The above pay scale reflects the broad, minimum to maximum pay scale for this job code for the location for which it has been posted. Even more importantly, salary is only one component of total compensation  also offer a competitive annual discretionary bonus program and opportunity for annual RSU grants (employees on sales‑incentive plans are not eligible for our annual bonus).

In addition, our highly competitive benefits package is designed to support your success at work, at home, and r recruiter will be happy to discuss all that Qualcomm has to offer – and you can review more details about our U.S. benefits at the provided link.

If you would like more information about this role, please contact Qualcomm Careers.