Previous Chapter: 2 Risk Analysis
Suggested Citation: "3 Development of Risk-Informed Strategies." National Academies of Sciences, Engineering, and Medicine. 2024. Risk Analysis Methods for Nuclear War and Nuclear Terrorism: Phase II (Expanded Abbreviated Report of the CUI Version). Washington, DC: The National Academies Press. doi: 10.17226/27745.

3

Development of Risk-Informed Strategies

Decision makers must often act with incomplete information—both for real-time, quick decisions to respond to crises as well as the slower paced (but no less important) development of a strategy that may involve future tactical decisions (Bentz 2022; Kurtz 2022; Vaddi et al. 2022). Both situations require a broad look at a variety of threats and outcomes weighed against resources, policies, and administration priorities.

During its information collection, the committee asked multiple agencies and individuals to identify opportunities for improvement in current U.S. government nuclear risk assessments and how this report might help address those gaps. Several themes emerged, including the following: the need for broader thinking to capture “the things not yet considered” as well as perspectives and input from U.S. allies and partners; a need for expanded adversarial intent modeling (e.g., “decision calculus”) and integrated intelligence collection efforts; the challenge of analyzing the risks of events that have not yet occurred (see Box 3-1); and, for risks associated with nuclear war in particular, the need for U.S. analysis to adapt to a rapidly changing deterrence environment. For this last item, it was noted that military and academic work on deterrence theory has not kept up with changes in deterrence, and that deterrence assessment by the Department of Defense (DoD) (and primarily the U.S. Strategic Command [USSTRATCOM]) alone is focused on DoD missions and objectives and does not capture wider U.S. government and policy objectives.1 Additionally, several agency representatives who were asked supported the need for increased participation in nuclear war and nuclear terrorism related tabletop exercises by senior administration officials, resulting in better awareness of nuclear weapon choices, timelines, policies, processes, and capabilities.2

Finding 3-1: Decision makers from across the U.S. government highlight a need for nuclear war and nuclear terrorism risk analysis to have a broader scope. Decision makers are concerned about signals or threats that they may be missing that could lead to rare but highly consequential surprises. In addition, those within and outside of the Department of Defense (DoD), highlight a need for nuclear war risk analyses to be conducted outside of DoD to consider a broader scope of pathways and outcomes.

___________________

1 In the Phase I report, game theory is highlighted as a method that has been successful in analyzing deterrence (NASEM 2023a; see Table 6-1 and surrounding text).

2 A Defense Science Board report in 2019 provided advice on how to improve the National Leadership Command and Control, including the establishment of an exercise, testing, and learning regimen [within leadership] (DSB 2019).

Suggested Citation: "3 Development of Risk-Informed Strategies." National Academies of Sciences, Engineering, and Medicine. 2024. Risk Analysis Methods for Nuclear War and Nuclear Terrorism: Phase II (Expanded Abbreviated Report of the CUI Version). Washington, DC: The National Academies Press. doi: 10.17226/27745.

A key component of the committee’s tasking was to explore the interface between risk assessment and the development of strategy (Tasks 4 and 5; see Box 1-2). The committee heard from a variety of U.S. government decision and policy makers who were asked about how they utilize risk assessments related to nuclear war and nuclear terrorism, what methods they used to guide decisions, and the assumptions they made in developing nuclear security strategy for the United States. The information collected to examine this interface is shown in Tables 2-1 and 2-2, in the columns labeled “Strategy.” Table 2-1, “Risk Analysis Methods Used by Decision Makers to Assess Risks of Nuclear War,” shows that most rely on intelligence-informed leadership judgment to guide strategy decisions. Table 2-2, “Risk Analysis Methods Used by Decision Makers to Assess Risks of Nuclear Terrorism,” shows that intelligence-informed leadership judgment and Department of Homeland Security (DHS) risk methodology are used by some agencies and departments.

Decisions that rely on intelligence and leadership judgment can be made quickly and are well-suited to address real-time issues. However, they are susceptible to bias and group think (see the Phase I report section “Challenges to the Elicitation and Use of Expert Opinion” and the references therein [NASEM 2023a]), and often the number of experts is limited, so the scope of possible outcomes is also limited. These known decision-making biases can be mitigated by risk analysis.

More importantly, intelligence assessments characterize foreign threats and do not usually include the interactions with U.S. behavior or include vulnerabilities, probabilities, and consequences (Murphy 2022; Fullerton 2023; Leslie 2023). The U.S. government characterizes analysis of its adversaries and the threats they pose as “red” (i.e., as in “red teams” that are assigned the role of adversaries in exercises). Response to threats to minimize the impact of potential consequences or to reduce the likelihood of occurrence are characterized as “blue” (i.e., the blue teams).

During the Cold War, the United States relied primarily on nuclear weapons to deter foreign attack. In the current situation, foreign adversaries rely on nuclear weapons to deter U.S. attack. Thus, it is impossible to analyze risks of deterrence failure without also analyzing U.S. plans or likely choices in various situations (i.e., scenarios).3 By relying on intelligence information to guide decisions, officials may be overlooking a large component of risk that could offer a wider array of choices, options, and insight into outcomes that may otherwise not have been considered. The committee also heard that decision makers often consider the worst-case or most-likely scenarios when outlining possible decisions and actions to take to address a specific problem.

Conclusion 3-1: Intelligence-informed leadership judgment is a common approach used by decision makers to guide nuclear policy and decisions. Another is the use of “worst-case scenarios” or “most-likely scenarios” to guide decisions. These approaches contain assumptions that limit options to decision makers in the following ways:

  1. Intelligence-informed leadership judgment assumes that the intelligence information provides sufficient context and information to inform decisions, but intelligence assessments are limited to assessing threats and decision making of adversaries. The intelligence assessments do not include interactions of adversaries with U.S. plans and choices nor, typically, the consequences of these interactions or vulnerabilities to the United States or its interests.
  2. A worst-case or most-likely scenario approach assumes that the analysis of these limited cases is sufficient to guide decision making. Rather, consideration of a wider set (or sets) of possible scenarios potentially leads to a wider array of choices and options as well as a deeper understanding of the dependencies between pathways that lead to a variety of outcomes, increasing the chances of identifying rare but highly consequential events before they occur.

IMPLEMENTING INTEGRATED DETERRENCE

Integrated deterrence, as defined in Box 1-1, expands the scope of deterrence across domains, regions, types of conflict, and the U.S. government and its allies and partners. With this expanded scope, it is important to not

___________________

3 This gap is due to a structural issue within the United States resulting from intelligence oversight rules. Addressing the structural gap is beyond the scope of this committee. However, there remains a critical need to conduct analyses that combine red and blue outcomes into an overall risk assessment, especially related to the use of nuclear weapons. Box 3-1 offers an improvised solution using exiting mechanisms and taking advantage of nascent efforts.

Suggested Citation: "3 Development of Risk-Informed Strategies." National Academies of Sciences, Engineering, and Medicine. 2024. Risk Analysis Methods for Nuclear War and Nuclear Terrorism: Phase II (Expanded Abbreviated Report of the CUI Version). Washington, DC: The National Academies Press. doi: 10.17226/27745.

lose sight of nuclear deterrence in particular. Nuclear war is a threat to the world as we know it. President Reagan’s famous 1982 quote, “Nuclear war cannot be won and must never be fought,” has been reiterated by the leaders of the five Nuclear Weapon States as recently as January 2022 (White House 2022). Yet, President Putin’s invasion of Ukraine and his threats to use nuclear weapons have highlighted the need for a wider variety of assessments of nuclear weapon use and its consequences.

The implementation of an expanded scope of deterrence provides an opportunity for the United States to address what some have characterized as a widening gap in deterrence strategy expertise between the United States and its adversaries. Brad Roberts’s On Theories of Victory, Red and Blue (Roberts 2020) highlights the gap in strategy development over the past few decades and cites a number of reports supporting this claim. The 2018 National Defense Strategy Commission’s Providing for the Common Defense (NDSC 2018, p. 1-2, paraphrased) emphasized the need for the United States to develop innovative operational approaches to overcome difficult operational challenges and a lack of analytical capability, expertise, and processes to guide DoD strategy. General Joseph Dunford noted that the United States is behind in adapting to the changed character of war (Dunford 2016), and Peter Roberts, director of Royal United Services Institute in London, has claimed that adversaries of the United Kingdom and the United States have reimagined warfare and conflict (Roberts 2017, pp. 14 and 23).

Multiple briefers to the committee mentioned a lack of senior leadership participation in exercises and war games that involve the use of nuclear weapons, and actions to take following their use. A recent National Academies of Sciences, Engineering, and Medicine report on U.S. nuclear forensics capability made the same finding and recommended more no-notice exercises involving senior leaders (NASEM 2021).

Conclusion 3-2: Deterrence is an enduring strategic concept that needs constant rethinking and adaptations that are tailored to fit new and existing adversaries, changing contexts, and new circumstances. The U.S. government has acknowledged an expanded scope for deterrence as integrated deterrence, which seeks new ways to integrate contributions to deterrence across multiple domains (e.g., military and nonmilitary organizations, U.S. agencies, and geographic regions). In this effort, the risk of deterrence failure leading to the use of nuclear weapons becomes one part of a larger set of risks. Due to the potentially catastrophic consequences of nuclear weapons’ use, the U.S. government must recognize and prioritize the need to develop specific assessments of the risks of nuclear weapons use while implementing an integrated deterrence strategy.

Conclusion 3-3: The current U.S. national security environment requires acknowledgment of the severity of nuclear war and nuclear weapon use, its myriad consequences, and the difficulties in making decisions in limited time and with little information. Lack of practice and participation by senior leadership in war games and exercises that simulate the use of nuclear weapons and follow-on responses increases the likelihood that real-life decisions related to nuclear weapon use will be impacted by confusion and lack of coordination.

As noted in Conclusion 2-1, risk analysis can provide a systematic way to widen the lens when considering options. For example, an existing, well-constructed risk analysis capability can assist both in making quick decisions and in the development of a long-term strategy. However, it requires active engagement of all sources of relevant information across government, industry, and academia. It also benefits from the attention and participation of decision makers throughout the process. DHS has a capability for assessing quantitative risks of nuclear terrorism, and a partial qualitative nuclear war risk analysis capability exists in USSTRATCOM’s RoSDF, but it is focused on military objectives. For example, RoSDF incorporates the impacts of economic sanctions as part of its analysis, engaging the Department of the Treasury and Intelligence Community (IC) in doing so.

Much more can be done, however, especially to capture a wider range of consequences and vulnerabilities. For example, within the U.S. government, multiple federal agencies that could contribute to an integrated-deterrence risk assessment of nuclear war are listed in Table 3-1. (This table is not intended to be exhaustive.) Other new and diverse strategic threats could also be considered, including chemical, biological, and cyber weapons and proliferation of nuclear weapons.

Suggested Citation: "3 Development of Risk-Informed Strategies." National Academies of Sciences, Engineering, and Medicine. 2024. Risk Analysis Methods for Nuclear War and Nuclear Terrorism: Phase II (Expanded Abbreviated Report of the CUI Version). Washington, DC: The National Academies Press. doi: 10.17226/27745.

TABLE 3-1 Examples of Federal Agencies with Relevant Expertise or Authority

Federal Agency Expertise or Authority

Department of Agriculture

Food resources

Department of Commerce:

Supply chains

National Oceanic and Atmospheric Administration

Environmental effects

Department of Defense:

Defense Intelligence Agency

Intelligence

Defense Threat Reduction Agency

Military consequences

U.S. Strategic Command and Geographical Combatant Commands

Nuclear strategy and planning including risk analysis, nuclear weapons, and nuclear security

Office of the Secretary of Defense Policy

Nuclear policy

Department of Energy:

Energy resources and energy security

National Nuclear Security Administration

Nuclear weapons and nuclear security

Office of Science: BER

Environmental effects

Department of Health and Human Services

Public health

Department of Homeland Security:

Homeland effects and response

Cybersecurity and Infrastructure Security Agency

Cyber threats and resilience; infrastructure security and resilience

Federal Emergency Management Agency

Preparedness, response, recovery, and resilience

Science and Technology Directorate

Threats and consequences modeling

Countering Weapons of Mass Destruction

Nuclear and radiological material detection and incident response

Customs and Border Protection and U.S. Coast Guard

Securing containerized supply chains and critical infrastructure

Department of the Interior

Water, mineral, and fossil fuel resources

Department of Justice

Legal effects

Federal Bureau of Investigation

Illegal activities in U.S. homeland; material trafficking; transnational terrorism and criminal networks

Department of State

International relations

Department of Transportation

Transportation and supply chains

Federal Aviation Administration

Air traffic

Department of the Treasury

Economic consequences and mitigation

Environmental Protection Agency

Environmental effects

Federal Communications Commission

Communication effects and response

Federal Reserve

Banking

Intelligence Community

Intelligence

National Aeronautics and Space Administration

Space effects

National Science Foundation: National Center for Atmospheric Research

Environmental effects

Nuclear Regulatory Commission

Nuclear–environmental effects and response to threats to commercial reactors

Office of the Director of National Intelligence

Intelligence threat analysis and adversary capabilities

National Counterproliferation Center

Suggested Citation: "3 Development of Risk-Informed Strategies." National Academies of Sciences, Engineering, and Medicine. 2024. Risk Analysis Methods for Nuclear War and Nuclear Terrorism: Phase II (Expanded Abbreviated Report of the CUI Version). Washington, DC: The National Academies Press. doi: 10.17226/27745.

For deterrence strategy to become integrated across its multiple domains, an interagency integrator with access to federal agency capabilities is needed to make best use of the information and responsibilities across the government.4 Examples of groups formed by the President to address high-priority topics include interagency working groups (IWGs), presidential task forces, and ad hoc groups (i.e., tiger teams).5 The advantage of declared interagency efforts is that it signals the importance of an issue and its priority within an administration. It also outlines the organization of the group and allows outside expert participation (e.g., academia, university-affiliated research centers, think tanks, private sector, and industry) and access to federal agency capabilities and resources such as federal agency experts including parts of DoD, the Department of Energy National Laboratories, and other federally funded research and development organizations. A recent example is the effort that outlined the U.S. Strategy for Countering WMD and Securing Nuclear and Radiological Materials.

Conclusion 3-4: The 2022 U.S. National Security Strategy calls for a national strategy for integrated deterrence. Yet the capability to conduct an integrated deterrence risk analysis, structured to explore outcomes that could lead to the use of nuclear weapons (by the United States, its allies, or its adversaries), does not currently exist within the U.S. government. The establishment of such a risk analysis capability, following best practices and capturing expertise across U.S. government agencies, would support better-informed decisions and longer-term strategy development but will require time and investment to develop.

As a starting point for action to address this gap, existing interagency ad hoc groups could begin incorporating best-risk analysis practices outlined in Box 2-1 into a wider-scale and enduring capability. Current examples are tiger teams that were used to assess decision making leading up to Russia’s invasion of Ukraine, as reported by the Washington Post and others.6 This capability would serve as a focal point for other interagency risk management proposals and efforts (even those not specifically asking for risk analysis).7 An early win could be an interagency effort to develop a set of possible scenarios leading to a variety of outcomes. Scenarios can be developed or modified to address immediate issues that arise, or they could be tailored for longer-term planning or be used as tabletop exercises.8 In the longer term, the capability would need to be codified with show of support and commitment by leadership through an Executive Order or similar means.

Several concepts that would contribute to establishing a risk analysis capability are listed in Box 3-1.

In addition, the committee identified a set of potential activities or actions that could expand the use of risk analysis to guide the implementation and management of integrated deterrence, especially as it relates to nuclear war. One option that could provide a focus on risks of nuclear weapons use in the context of integrated deterrence is to reinstate or re-create a similar function to the National Intelligence Officer for Warning. Yet another idea was to create an annual or biannual federally hosted workshop or meeting to share nuclear risk methods and results across the U.S. government. This could increase awareness of others working in the same space, encourage the sharing of capabilities, and/or improve integration.

___________________

4 Currently, the Department of Defense (DoD) is leading the implementation of the integrated deterrence strategy.

5 A presidential task force or White House task force is a board of advisors appointed by the President of the United States whose main purpose is to enact policies in relation to responding to either national emergencies, crises, or general policy initiatives.

6 A nascent capability to analyze risks of nuclear war may be under development by the current National Security Advisor and a team of National Security Council (NSC) officials in the form of an emergency task force or “tiger team” created in February 2022. Per media reporting, the tiger team was initially tasked with considering options for a response to the use of a weapons of mass destruction by Russia in its conflict with Ukraine, and the press reported that tabletop exercises were conducted to identify possible outcomes. (See Collins 2022; Nakashima and Parker 2022; and Sanger et al. 2022.)

7 For example, a recent National Academies’ committee recommended the establishment of a similar capability: an interagency effort to establish a process for identifying and assessing threats and vulnerabilities of strategic significance to U.S. technology leadership and other interests be established and led by NSC, the National Science and Technology Council, and the National Economic Council, ensuring a “whole-of-government” approach (NASEM 2022).

8 The use of scenarios in this context is meant to describe a class of scenarios that plausibly might occur—without assigning likelihood or probability. In other contexts, “scenarios” describe the different pathways that could lead to outcomes. For example, DHS’s risk assessment tool creates millions of scenarios to assess risk.

Suggested Citation: "3 Development of Risk-Informed Strategies." National Academies of Sciences, Engineering, and Medicine. 2024. Risk Analysis Methods for Nuclear War and Nuclear Terrorism: Phase II (Expanded Abbreviated Report of the CUI Version). Washington, DC: The National Academies Press. doi: 10.17226/27745.

BOX 3-1
Concepts for an Interagency Nuclear Risk Analysis Capability to Guide Decisions

The National Security Advisor is in a position to coordinate and integrate the required expertise from across the entire government in responding to an imminent nuclear crisis or planning for future crises by the establishment of an interagency integrated deterrence risk analysis capability. This capability must be supported by technically based and enduring expertise such as that residing within the federal agencies as well as outside experts. Examples of agencies with relevant expertise are listed in Table 3-1. This capability would likely be invisible at most times to agency and administration decision makers.

This capability would not lie dormant, however, as it would need to

  1. Identify possible scenarios leading to the use of nuclear weapons as threats and capabilities evolve;
  2. Identify the necessary consequence estimates on which risk analysis is based;
  3. Integrate consequence results into risk evaluations and prioritization decisions; and
  4. Develop, train, and encourage communication and coordination using the necessary crisis management processes.

In summary, this risk analysis capability would be exercised at the technical level until operationally needed, possibly on short notice.

Suggested Citation: "3 Development of Risk-Informed Strategies." National Academies of Sciences, Engineering, and Medicine. 2024. Risk Analysis Methods for Nuclear War and Nuclear Terrorism: Phase II (Expanded Abbreviated Report of the CUI Version). Washington, DC: The National Academies Press. doi: 10.17226/27745.
Page 23
Suggested Citation: "3 Development of Risk-Informed Strategies." National Academies of Sciences, Engineering, and Medicine. 2024. Risk Analysis Methods for Nuclear War and Nuclear Terrorism: Phase II (Expanded Abbreviated Report of the CUI Version). Washington, DC: The National Academies Press. doi: 10.17226/27745.
Page 24
Suggested Citation: "3 Development of Risk-Informed Strategies." National Academies of Sciences, Engineering, and Medicine. 2024. Risk Analysis Methods for Nuclear War and Nuclear Terrorism: Phase II (Expanded Abbreviated Report of the CUI Version). Washington, DC: The National Academies Press. doi: 10.17226/27745.
Page 25
Suggested Citation: "3 Development of Risk-Informed Strategies." National Academies of Sciences, Engineering, and Medicine. 2024. Risk Analysis Methods for Nuclear War and Nuclear Terrorism: Phase II (Expanded Abbreviated Report of the CUI Version). Washington, DC: The National Academies Press. doi: 10.17226/27745.
Page 26
Suggested Citation: "3 Development of Risk-Informed Strategies." National Academies of Sciences, Engineering, and Medicine. 2024. Risk Analysis Methods for Nuclear War and Nuclear Terrorism: Phase II (Expanded Abbreviated Report of the CUI Version). Washington, DC: The National Academies Press. doi: 10.17226/27745.
Page 27
Suggested Citation: "3 Development of Risk-Informed Strategies." National Academies of Sciences, Engineering, and Medicine. 2024. Risk Analysis Methods for Nuclear War and Nuclear Terrorism: Phase II (Expanded Abbreviated Report of the CUI Version). Washington, DC: The National Academies Press. doi: 10.17226/27745.
Page 28
Next Chapter: 4 Conclusion
Subscribe to Email from the National Academies
Keep up with all of the activities, publications, and events by subscribing to free updates by email.