The Artificial Intelligence Testing Act of 2025
This legislation aims to establish a pilot program that uses testbeds to develop measurement standards for the evaluation of artificial intelligence systems.
Section 1: Short Title
Section 2: Definitions
- Artificial Intelligence System: The term “artificial intelligence system” has the meaning given to the term “artificial intelligence” in section 5002 of the National Artificial Intelligence Act of 2020 (15 U.S.C. 9401)
- Covered Foreign Country: The term “covered foreign country” means the People’s Republic of China; the Russian Federation; the Democratic People’s Republic of Korea; and the Islamic Republic of Iran
- Director: The term “Director” means the Director of the National Institute of Standards and Technology
- Institute: The term “Institute” means the National Institute of Standards and Technology
- Testbed: The term “testbed” means a facility or mechanism equipped for conducting rigorous, transparent, and replicable testing of tools or technologies to evaluate the functionality, performance, and security of those tools or technologies
Section 3: Pilot Program on Testbeds for Development of Measurement Standards for Evaluation of Artificial Intelligence Systems
The Director shall carry out a pilot program of testbeds to assess the feasibility and advisability of developing measurement standards for the evaluation of artificial intelligence systems used by Federal agencies through the use of testbeds.
- Pilot Program Required: The Director shall, in coordination with the Secretary of Energy and after consultation with the Working Group, carry out a pilot program of testbeds to assess the feasibility and advisability of developing measurement standards for the evaluation of artificial intelligence systems
- Process: The Director shall carry out the pilot program required by paragraph (1) by building and demonstrating an iterative process whereby measurement science is advanced and standards are developed using testbeds in accordance with subsection (d), and the results of the tests are reviewed by stakeholders from government, the private sector, and academia
- Memorandum of Understanding: Not later than 180 days after the date of the enactment of this Act, the Secretary of Commerce and the Secretary of Energy shall enter into a memorandum of understanding to implement the coordination between the Secretary of Energy and the Director required by paragraph (2)
Section 4: Artificial Intelligence Testing Working Group
The Secretary of Commerce shall establish a working group to provide advice to the Secretary of Commerce and the Secretary of Energy on the development of measurement standards for the evaluation of artificial intelligence systems.
- Establishment: The Secretary of Commerce shall establish a working group not later than 90 days after the memorandum of understanding required by subsection (b)(1) is signed
- Memberships: The Working Group shall be comprised of not more than 10 members that include the following: the Secretary of Commerce or a designee, the Secretary of Energy or a designee, the Director or a designee from the Institute, and representatives from the private sector, academia, and other stakeholders
- Prohibition: No citizen of a covered foreign country may serve as a member of the Working Group
Section 5: Strategy for Measurement Standards
The Working Group shall develop a strategy for the development of measurement standards for the evaluation of artificial intelligence systems.
- Elements: The strategy required by subsection (A) shall include
- Measurement Standards: Identification of measurement standards that the members of the Working Group consider necessary, including standards with respect to reliability, performance, capability, interpretability, security, privacy, data bias, and bounds for applicability and use cases
- Proposed Blueprint: A proposed blueprint for developing the measurement standards
- Initial Applications: Identification of the applications or artificial intelligence systems to which the standards should initially apply
- Metrics: Identification of metrics for the assessment of the pilot program
Section 6: Development of Testbeds for Measurement Standards
The Director shall, in collaboration with the Secretary of Energy and in coordination with the Working Group, develop testbeds on which to demonstrate the development of measurement standards for the evaluation of artificial intelligence systems.
- Development: Not later than 2 years after the date of the enactment of this Act, the Director shall, in collaboration with the Secretary of Energy and in coordination with the Working Group, develop testbeds on which to demonstrate the development of measurement standards for the evaluation of artificial intelligence systems
- Xpertise: In carrying out paragraph (1), the Director may hire any expert the Director considers necessary, including experts from academia, industry, and standards development organizations
Section 7: Report
The Director shall submit to Congress a report that reviews the findings of the Director with respect to the initial demonstration carried out under this section, recommends revisions to the pilot program plan, including by identifying any resources, funding, or personnel that is needed to improve and continue the development of testbeds and measurement standards for the evaluation of artificial intelligence systems.
About The Author
