Agentic AI Benchmarking and Evaluation Engineer

Job Summary
:

Qualcomm Technologies, Inc. is seeking talented ML/AI algorithm evaluation engineers to join their AI Research team. The role involves evaluating ML software tools and algorithms, collaborating with engineers to ensure quality standards, and developing optimized machine learning solutions for generative AI applications.

Responsibilities
:

• Evaluate ML software tools and algorithms to ensure they meet quality standards.

• Collaborate with members of the software teams and plan a comprehensive evaluation approach.

• Implement the evaluation strategy, deciding key performance metrics (KPIs), developing automation, and performing qualitative tests.

• Develop a deep understanding of the ML algorithms developed in the project.

• Apply tools and algorithms on a wide variety of use cases, develop best practices, provide detailed analysis, extend research, and identify areas for further optimization.

• Perform in-depth benchmarking, and model evaluation, to ensure AI systems meet safety standards.

Qualifications
:
Required
:

• Exceptional software development skills with excellent analytical, development, and debugging skills.

• Strong understanding of Machine Learning fundamentals.

• Understanding of generative AI and its usage in various application.

• Experience with LLM, LVM, LMM models, and other NN architectures.

• Proficiency in designing, implementing and training ML algorithms in high-level languages/frameworks (PyTorch and Tensor Flow).

• Excellent interpersonal, written, and oral communications skills.

• Bachelors degree in Computer Science, Engineering, Information Systems, or related field.

Preferred
:

• MS or PhD in Computer Science/Engineering with 2+ years of professional or equivalent experience.

• 2 years of proven experience in software development for GenAI, machine learning or high-performance computing with strong programming skills in Python and software design.

• Familiarity with AI agent frameworks (like Lang Chain, Llama Index, Autogen).

• Experience using/integrating Qualcomm AI Stack products (e.g. QNN, SNPE, QAIRT).

• Experience with machine learning accelerators, optimizing algorithms for hardware acceleration cores, working with heterogeneous or parallel computing systems.

• Experience driving cross-functional projects, including close collaboration with AI application teams to translate product needs into evaluation frameworks.

• Design and develop generalized AI solutions, including RAG systems, to enhance user capabilities with our AI accelerators.

• Experience in Android/Linux or other embedded systems.

Company
:

Qualcomm designs wireless technologies and semiconductors that power connectivity, communication, and smart devices. Founded in 1985, the company is headquartered in San Diego, USA, with a team of 10001+ employees. The company is currently Late Stage.