Completed
Any project, supported or not by a committee, that has not deposited records to the Records Office.
Effectively incorporating human insight and oversight is critical to implementing artificial intelligence systems. However, the use of AI tools in real-world environments introduces new challenges.
Our recent workshop series explored the latest thinking and best practices on human and organizational factors in deploying AI technologies. Our new proceedings summarizes these discussions, with a focus on ways to broaden stakeholder participation in the development of AI tools; ways to improve evaluation, testing, and oversight; and the interplay between AI and organizational cultures. This work complements the recently published "AI Risk Management Framework" from the National Institute of Standards and Technology (NIST).
Featured publication
Workshop
ยท2025
On June 11, 20, 26 and July 2, 2024, the National Academies of Sciences, Engineering, and Medicine held a series of workshop sessions to consider human and organizational factors of artificial intelligence (AI) risk management. The first three sessions - which examined community participation, testi...
View details
Description
The National Academies of Sciences, Engineering, and Medicine will organize a workshop to identify and explore approaches to addressing human and organizational risks in AI systems. The emphasis will be on approaches that could be included in a more detailed guidance document complementing the recently issued "AI Risk Management Framework" from the National Institute of Standards and Technology (NIST). Areas of interest in the context of the NIST framework include human insights about AI-produced output and human oversight of AI systems and their operation in real-world environments.
A planning committee will be appointed to organize the workshop. The workshop will take the form of a series of sessions spaced over a couple of months in order to maximize opportunities for participation and allow time for participants to reflect on prior discussions. A proceedings in brief summarizing highlights of discussions across the sessions, will be prepared by a rapporteur (selected by the Academies and not a member of the planning committee).
Collaborators
Committee
Co-Chair
Co-Chair
Member
Member
Member
Member
Member
Member
Member
Member
Member
Member
Sponsors
National Institute of Standards and Technology
Other, Federal
Staff
Shenae Bradley
Emanuel Robinson
Major units and sub-units
Division on Engineering and Physical Sciences
Lead
Division of Behavioral and Social Sciences and Education
Lead
Center for Advancing Science and Technology
Lead
Computer Science and Telecommunications Board
Lead
Board on Human-Systems Integration
Lead
Computing Research, Technologies, and Systems Program Area
Lead