Assistant Research Scientist; PREP

Overview

PREP Research Associate

Project

Description:

This project contributes to the development of the Metrics Hub within the NIST's Trustworthy and Responsible Artificial Intelligence Resource Center (AIRC). The student will assist in collecting and packaging relevant metrics for AI testing, identifying key metadata that support the creation of accessible resources for the AIRC website, benefiting the broader AI community and the public. This project will support the operationalization of the NIST AI Risk Management Framework (AI RMF 1.0) by providing essential metrics for testing, evaluation, verification, and validation (TEVV) of AI systems.

Research

Title:

AIRC Metric Hub Development

• Identify and collect relevant metrics for AI TEVV, aligning with the AI RMF 1.0.
• Curate the collected metrics, ensuring they are packaged, accessible and usable for the users of the AIRC website.
• Help design relevant use cases that contextualize metrics for the border AI community.
• Collaborate effectively with cross-functional and interdisciplinary stakeholders to ensure successful project outcomes.

• A set of AI metrics identified, packaged, and made available through the AIRC Metrics Hub. Estimating 2-5 metrics per month.
• Draft document outlining at least one use case per metric that illustrates the practical application in AI testing.

• Familiarity with concepts related to testing, evaluation, verification, and validation (TEVV) of AI systems.
• Background in Computer Science, Statistics, HCI, or related field.
• Education level: graduate student.
• Strong interest in metrics for AI systems.
• Familiarity with scientific reading and technical writing.

• Please upload the following with your application:
• CV/Resume (limit CV to 3 pages and include a valid email address for contact information).
• Self portraits (note: this item appears in the original text; consider removing if not required).
• Phone number.
• Home address/Country.
• Citizenship status.
• Languages spoken.
• Sex/Gender.
• Privacy Act Statement (Information collection, disclosure, and voluntary nature).
• To apply for this position, visit the application portal (no URL shown here).

• Salary Range: The referenced salary range represents the minimum and maximum salaries for this position and is based on the institution's good faith belief at the time of posting. Not all candidates will be eligible for the upper end of the salary range. The actual compensation offered may vary based on location, skills, experience, internal equity, market conditions, education/training, and other factors.
• Total Rewards: Johns Hopkins offers a total rewards package supporting health, life, career and retirement. More information can be found on the university benefits page.

• Equal Opportunity
  
  Employer:
  
  The Johns Hopkins University is committed to equal opportunity and does not discriminate on the basis of sex, gender, marital status, pregnancy, race, color, ethnicity, national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status or other legally protected characteristics. Qualified individuals will have access to all programs and benefits on the basis of demonstrated ability, performance and merit.
• Pre-Employment Information: If you require special assistance or accommodation during any part of the pre-employment process, please contact the HR office. TTY users may use Maryland Relay or dial 711. Further information about workplace accommodations is available via the accessibility office.
• Background Checks: The successful candidate will be subject to a pre-employment background check including education verification.
• EEO is the Law: Government notice that outlines rights and protections in employment.
• Diversity and Inclusion: The university values diversity, equity and inclusion and advances these through its roadmap on diversity and inclusion.
• Vaccine Requirements: Vaccine requirements information and exceptions may apply depending on campus. Details are provided for specific campuses and positions.

Note:

This refinement preserves the core content about the role, responsibilities, and qualifications while removing collaboration-irrelevant boilerplate and restructuring the text into accessible sections using only permitted HTML elements.