Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda
2025

Consensus

You must be logged in to download this publication.

Select Book Type

Paperback - $22.50

Request an exam or desk copy

Advances in artificial intelligence, and specifically in machine learning, are enabling new capabilities across nearly every sector of the economy. Many of these applications - such as automated vehicles, the power grid, or surgical robots - are safety critical: where malfunctions can result in harm to people, the environment, or property. While machine learning is already being deployed to enhance the capabilities of some physical systems, extending the rigorous practices of safety engineering to include machine learning components brings significant challenges.

Machine Learning for Safety-Critical Applications explores ways to safely integrate machine learning into physical systems and presents research priorities for improving safety, testing, and evaluation. This report finds that designing machine learning algorithms in a way that aligns with safety engineering standards will require changes in research, training, and engineering practice - as well as a shift away from focusing on algorithmic performance in isolation.

Additional materials

Interactive Overview
Public Briefing Slides

Publication information

82 pages · 8.5 x 11 · paperback
ISBN Paperback: 0-309-72666-2
ISBN Ebook: 0-309-59994-6
DOI: https://doi.org/10.17226/27970

Suggested citation

National Academies of Sciences, Engineering, and Medicine. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, DC: The National Academies Press.

Import this citation to:

Bibtext
EndNote
Reference manager

First Name
Last Name
Email (required)
I agree to receive emails from the National Academies (required)

We respect your privacy and will never share your information.

Search this publication

Front Matter i-xii
Summary 1-7
1 Engineering Safety-Critical Systems in the Age of Machine Learning 8-20
2 State of the Art, Promises, and Risks of Machine Learning 21-36
3 System Engineering with Machine Learning Components for Safety-Critical Applications 37-47
4 A Research Agenda to Bridge Machine Learning and Safety Engineering 48-56
5 Societal Considerations to Build Public Understanding and Confidence in Safety-Critical Systems with Machine Learning Components 57-65
Appendix A: Statement of Task 66-66
Appendix B: Briefings to the Committee 67-67
Appendix C: Committee Member Biographical Information 68-72

Log In

Former MyNAP users: You'll need to reset your password on your first login to MyAcademies. Click "Forgot password" below to receive a reset link via email. Having trouble? Visit our FAQ page to contact support.

Members of the National Academy of Sciences, National Academy of Engineering, or National Academy of Medicine should log in through their respective Academy portals.

Email (required)
Password (required)

Don't have an account?

Register

Email (required)
New password (required)
Retype password (required) Password must be at least 8 characters
I accept the terms of use
terms of use

Thank You

Thank you for creating a MyAcademies account!

Enjoy free access to thousands of National Academies' publications, a 10% discount off every purchase, and build your personal library.

Forgot Password

Enter the email address for your MyAcademies (formerly MyNAP) account to receive password reset instructions.

Email (required)

Reset Requested

We sent password reset instructions to your email . Follow the link in that email to create a new password. Didn't receive it? Check your spam folder or contact us for assistance.

Reset Password

New password (required)
Retype password (required) Password must be at least 8 characters

Reset Password

Your password has been reset.

Verify email

Verify Your Email Address

We sent a verification link to your email. Please check your inbox (and spam folder) and follow the link to verify your email address. If you did not receive the email, you can request a new verification link below

Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda (2025)

Chapter: 3 System Engineering with Machine Learning Components for Safety-Critical Applications

Additional materials

Publication information

Suggested citation

My Academies

Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda (2025)

Chapter: 3 System Engineering with Machine Learning Components for Safety-Critical Applications