Expert Annotation for Datasets Critical to AI systems Evaluation, Validation, and Safety Verification

This procurement will establish a multi-award BOAs to fulfill a critical NIST research need by developing expert annotated datasets, including benchmarks and other measurement instruments, necessary to advance AISI’s ability to rigorously measure crucial AI system characteristics, such as the functionality and capabilities of frontier models. These datasets can improve evaluations of advanced AI systems both for their potential adoption in government and to track global AI developments and competition.

Estimated value

$150K - $249K

Contract type

Unknown

• NAICS541690
• PSC541690