Completed
The Department of Defense operates several ranges across all service branches to test the effectiveness of military systems. The DoD’s Office of Test and Evaluation (DOT&E) has asked the Board on Army Research and Development to assess the physical and technical suitability of the DoD's ranges, infrastructure, and tools used for test and evaluation of military systems' operational effectiveness, suitability, survivability, and lethality across all domains (land, sea, air, space, and cyberspace).
This study is conducted in parallel with a classified study on the operational suitability of DoD ranges, namely their capacity to simulate adversary threats and test future technologies.
Featured publication
Consensus
·2021
Rigorous operational testing (OT) of weapon systems procured by the U.S. Department of Defense (DoD) is fundamental to ensuring that these sophisticated systems not only meet their stated requirements, but also perform under realistic operational conditions when faced by determined adversaries emplo...
View details
Description
The National Academies of Sciences, Engineering, and Medicine will convene an ad hoc committee to assess the physical and technical suitability of the Department of Defense's (DoD) ranges, infrastructures, and tools used for test and evaluation (T&E) of military systems' operational effectiveness, suitability, survivability, and lethality across all domains (land, sea, air, space, and cyberspace).
Specifically, the committee will:
1. 1) Assess the aggregate physical suitability of DoD's ranges to include their testing capacity, the condition of their infrastructure, security measures, and encroachment challenges.
2. 2) Assess the technical suitability of ranges to include spectrum management, instrumentation, cyber and analytics tools, and their modeling and simulation capacity.
3. 3) Evaluate the following attributes for each range:
· Physical Attributes of Range: Do ranges allow for full exercise of tested systems in the manner they will be used to achieve their mission?
· Electromagnetic Attributes of Range: Can the system under test, and emulated threats to the system, access and utilize spectrum as designed and needed?
· Range Infrastructure: Can range instrumentation properly and fully assess system performance and record test data (as well as training data that could be applied to T&E requirements)? Can range tools adequately process and transmit test data and efficiently provide test results?
· Test Infrastructure Security: How secure are ranges, infrastructure and test capabilities against physical and cyber intrusion that could lead to exploitation of weapon systems performance data by an adversary?
· Encroachment Threats and Impacts: What are the existing and potential future encroachment threats and impacts (physical space, spectrum, alternative/competing DoD uses)?
4. 4) The committee will recommend how the DoD can address and/or mitigate any existing or anticipated deficiencies, and test and evaluate future technologies anticipated to arrive between now and 2035, including discussion of planning and resource allocation for the overall test range enterprise. These technologies include, but are not limited to:
Directed energy, hypersonic systems, autonomous systems, artificial intelligence, space systems and threats, 6th generation aircraft, advanced acoustic and non-acoustic technologies for undersea warfare, and advanced active electronic warfare/cyber capabilities.
Contributors
Committee
Chair
Member
Member
Member
Member
Member
Member
Member
Member
Member
Member
Member
Member
Conflict of Interest Disclosure
Dr. Keoki Jackson has a conflict of interest in relation to his service on the consensus study committee for Assessing the Physical and Technical Suitability of DoD Test and Evaluation Ranges and Infrastructure because of his current affiliation with Lockheed Martin, which develops products for the Department of Defense (DoD), many of which undergo operational test and evaluation at the DoD ranges that are included in the study. Lockheed Martin also has an operations contract with the National Cyber Range Complex, which is under the purview of DoD’s Test and Resource Management Center and the location of one of the site visits for this study. The National Academies has concluded that in order for the committee to accomplish the tasks for which it was established, its membership must include at least one person with current and directly relevant industry experience related to defense space systems as well as the interactions between the defense industry and the DoD test ranges, including contractor agreements on operational program testing. As described in his biographical summary, Dr. Jackson has extensive current experience in the engineering and oversight of national security space systems and space-based defense programs, including adequate instrumentation for test data transmission and collection; suitable physical and technical environments for test exercises; appropriate modeling and simulation parameters for executing tests that cannot be done in open air; and procedures for flight termination systems. The National Academies has determined that the experience and expertise of Dr. Jackson is needed for the committee to accomplish the task for which it has been established. The National Academies could not find another available individual with the equivalent experience and expertise who does not have a conflict of interest. Therefore, the National Academies has concluded that the conflict is unavoidable. The National Academies believes that Dr. Jackson would serve effectively as a member of the study committee, and the committee can produce an objective report, taking into account the composition of the committee, the work to be performed, and the procedures to be followed in completing the study.
Dr. Rob Kewley has a conflict of interest in relation to his service on the consensus study committee for Assessing the Physical and Technical Suitability of DoD Test and Evaluation Ranges and Infrastructure because of his current affiliation as a consultant for multiple companies that compete for modeling and simulation support for DoD programs, including programs in the test domain. The National Academies has concluded that for this committee to accomplish the tasks for which it was established, its membership must include at least one expert with current direct experience in the application and complexities of modeling and simulation for DoD test and evaluation. As described in his biographical summary, Dr. Kewey has extensive current experience in modeling and simulation as Director and Systems Engineer of a company that provides cloud-based modeling and simulation architectures for businesses and is a leader in international efforts for establishing cloud-based modeling and simulation standards. In addition, Dr. Kewley’s experience as the former head of systems engineering at West Point and former acting Assistant Secretary of the Army of Acquisition, Logistics, and Technology for the Office of the Chief Systems Engineer provide unique expertise in the application of modeling and simulation for military support. The National Academies has determined that the experience and expertise of Dr. Kewley is needed for the committee to accomplish the task for which it has been established. The National Academies could not find another available individual with the equivalent modeling and simulation experience and DoD expertise who does not have a conflict of interest. Therefore, the National Academies has concluded that the conflict is unavoidable. The National Academies believes that Dr. Kewley would serve effectively as a member of the study committee, and the committee can produce an objective report, taking into account the composition of the committee, the work to be performed, and the procedures to be followed in completing the study.
Mr. Derrick Hinton has a conflict of interest in relation to his service on the consensus study committee for Assessing the Physical and Technical Suitability of DoD Test and Evaluation Ranges and Infrastructure because of his current affiliation as an employee of the company Scientific Research Corporation (SRC), whose business activities are focused on a broad range of information, communications, intelligence, electronic warfare, simulation, training, and instrumentation systems for both commercial and defense operational environments. The National Academies has concluded that for this committee to accomplish the tasks for which it was established, its membership must include at least one expert who has recent direct experience managing the current and projected challenges facing DoD test and evaluation ranges. As described in his biographical summary, Mr. Hinton has extensive and recent experience in DoD testing and evaluation through his former position as the Acting Director of the Test Resource Management Center (TRMC), where he supervised test and evaluation strategic planning at DoD, and provided oversight of DoD test and evaluation ranges. The National Academies has determined that Mr. Hinton’s experience and expertise is necessary for the committee to accomplish the task for which it has been established. The National Academies could not find another available individual with the equivalent and recent experience and who does not have a conflict of interest. Therefore, the National Academies has concluded that the conflict is unavoidable. The National Academies believes that Mr. Hinton would serve effectively as a member of the study committee, and the committee can produce an objective report, taking into account the composition of the committee, the work to be performed, and the procedures to be followed in completing the study.
Sponsors
Department of Defense
Staff
Lida Beninson
Lead
Tina Latimer
Linda Walker