Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force (2023)
Chapter: Appendix D: Acronyms and Abbreviations
Visit
NAP.edu/10766
to get more information about this book, to buy it in print, or to
download it as a free PDF.
Previous Chapter:
Appendix C: Committee Member Biographical Information
D
Next Chapter: Appendix E: Testing, Evaluating, and Assessing Artificial IntelligenceEnabled Systems Under Operational Conditions for the Department of the Air Force: Proceedings of a Workshop—in Brief
Suggested Citation:
"Appendix D: Acronyms and Abbreviations." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press.
doi: 10.17226/27092.
D
Acronyms and Abbreviations
| AAIT | Autonomy and Artificial Intelligence Test |
| ABMS | Advanced Battle Management System |
| ACC | Air Combat Command |
| ACE | Air Combat Evolution |
| ADAX | Autonomy, Data, and AI Experimentation |
| AEDC | Arnold Engineering Development Complex |
| AEIS | Artificial Intelligence Enabled Systems |
| AF DCGS | Air Force Distributed Common Ground Station |
| AFB | Air Force Base |
| AFIT | Air Force Institute of Technology |
| AFLCMC | Air Force Life Cycle Management Center |
| AFMC | Air Force Materiel Command |
| AFOTEC | Air Force Operational Test and Evaluation Center |
| AFPC | Air Force Personnel Center |
| AFRL | Air Force Research Laboratory |
| AFSC | Air Force Specialty Code |
| AFTC | Air Force Test Center |
| AI | artificial intelligence |
| AI4NSL | Artificial Intelligence for National Security Leaders |
| AIA | AI Accelerator |
| AICI | Artificial Intelligence Criticality Indicator |
| AIOps | Artificial Intelligence for IT Operations |
Suggested Citation:
"Appendix D: Acronyms and Abbreviations." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press.
doi: 10.17226/27092.
| API | Application Programming Interface |
| APIGEE | Automated Pipeline for Imagery Geospatial Enhancement and Enrichment |
| ASIL | Automotive Safety Integrity Level |
| ATR | automatic target recognition |
| AWCFT | Algorithmic Warfare Cross-Functional Team |
| AWS | Amazon Web Services |
| BPA | bulk purchase agreement |
| C2 | Command and Control |
| C2BMC | Command, Control, Battle Management, Communications |
| C4I | Command, Control, Communications, Computers, and Intelligence |
| C4ISR | Command, Control, Communications, Computers, Intelligence, Surveillance and Reconnaissance |
| CAC | common access card |
| CBA | capabilities-based analysis |
| CCA | Collaborative Combat Aircraft |
| CCF | common cause failure |
| CDAO | Chief Digital and AI Office (OSD); Chief Data and AI Office (DAF) |
| CDC | Capability Development Council |
| CET | continuing education and training |
| CEU | continuing education unit |
| CI/CD | continuous integration/continuous delivery |
| CIP | critical intelligence parameter |
| CLSA | Computer Language Self-Assessment |
| CMCC | Common Mission Control Center |
| CNN | Convolutional Neural Network |
| CoI | community of interest |
| CONOPS | concept of operations |
| CR | certifiable robustness |
| CSAF | Chief of Staff of the Air Force |
| CTP | critical technical parameter |
| CV | computer vision |
| CXO | chief experience officer |
| DAF | Department of Air Force |
| DARPA | Defense Advanced Research Projects Agency |
Suggested Citation:
"Appendix D: Acronyms and Abbreviations." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press.
doi: 10.17226/27092.
| DASD(DT&E) | Deputy Assistant Secretary of Defense for Developmental Test and Evaluation |
| DAU | Defense Acquisition University |
| DDB | Dynamic Database |
| DevOps | development operations |
| DevSecOps | development, security, and operations |
| DGS | Defense Geospatial Services |
| DIE | Defense Intelligence Enterprise |
| DL | deep learning |
| DMP | data management pipeline |
| DNN | deep neural networks |
| DoD | Department of Defense |
| DOT&E | Director of Operational Test and Evaluation |
| DOTmLPF-P | Doctrine, Organization, Training, materiel, Leadership, Personnel, Facilities, Policy |
| DRL | deep reinforcement learning |
| DT | developmental test |
| DT&E | developmental test and evaluation |
| DTO | Digital Transformation Office |
| ELINT | electronic intelligence |
| EO | electro-optical |
| EOB | Electronic Order of Battle |
| EW | electronic warfare |
| EWIR | electronic warfare integrated reprogramming |
| FAA | Federal Aviation Administration |
| FERET | Face Recognition Technology |
| FFRDC | federally funded research and development center |
| FM | foundation model |
| FMV | full-motion video |
| FOC | fully operational capability |
| FOT&E | follow-on operational T&E |
| FPGA | field programmable gate array |
| GAO | Government Accountability Office |
| GeoINT | geospatial intelligence |
| GOTS | government off-the-shelf |
| GPU | graphics processing unit |
| GSWR | Global Synthetic Weather Radar |
Suggested Citation:
"Appendix D: Acronyms and Abbreviations." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press.
doi: 10.17226/27092.
| HAI | human-AI |
| HARA | Hazard and Risk Assessment |
| HMC | human-machine cognitive collaboration |
| HMT | human-machine team |
| HRL | human readiness level |
| HSI | human-systems integration |
| HW | hardware |
| IDA | Institute for Defense Analyses |
| IEC | International Electrotechnical Commission |
| ILSVRC | ImageNet Large Scale Visual Recognition Challenge |
| IML | informed machine learning |
| IOC | initial operating capability |
| IOT&E | initial operational test and evaluation |
| IP | intellectual property |
| IR | infrared |
| ISO | International Organization for Standardization |
| ISR | intelligence, surveillance, and reconnaissance |
| IT | information technology |
| JAIC | Joint Artificial Intelligence Center |
| JATIC | Joint Artificial Intelligence Test Infrastructure Capability |
| JCIDS | Joint Capabilities Integration and Development System |
| JEON | joint emergent operational need |
| JHU APL | Johns Hopkins University Applied Physics Laboratory |
| JROC | Joint Requirements Oversight Council |
| JSE | joint simulation environment |
| JUON | joint urgent operational need |
| KPI | key performance indicator |
| KPP | key performance parameter |
| KSA | key system attribute |
| LAWS | lethal autonomous weapon system |
| LFT&E | live-fire test and evaluation |
| LL | Lincoln Laboratory |
| LLM | large language model |
| LOR | level of rigor |
| LSTM | long-short-time memory |
| LVC | live-virtual-constructive |
Suggested Citation:
"Appendix D: Acronyms and Abbreviations." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press.
doi: 10.17226/27092.
| M&S | modeling and simulation |
| MAGE | Machine Assisted GeoINT Exploitation |
| MAIS | major automated information system |
| MDA | Missile Defense Agency |
| MDAP | major defense acquisition program |
| MIT | Massachusetts Institute of Technology |
| ML | machine learning |
| MLOps | machine learning operations |
| MRTFB | Major Range and Test Facility Base |
| MSTAR | Moving and Stationary Target Acquisition and Recognition |
| MTA | middle tier of acquisition |
| MVP | minimal viable product |
| NAIIO | National AI Initiative Office |
| NAITIC | National Artificial Intelligence Test and Evaluation Infrastructure Capability |
| NDAA | National Defense Authorization Act |
| NeRF | neural radiance field |
| NFS | NextGen Federal Systems |
| NGAD | next generation air dominance |
| NIST | National Institute of Standards and Technology |
| NLP | natural language processing |
| NPS | Naval Postgraduate School |
| NR-KPP | net ready key performance parameter |
| NSCAI | National Security Commission on AI |
| O&M | operations and maintenance |
| OCR | operational change request |
| ODD | operational design domain |
| ODNI | Office of the Director of National Intelligence |
| OFP-CTF | Operational Flight Program-Combined Test Force |
| OOD | out-of-distribution |
| OSD | Office of the Secretary of Defense |
| OT | operational test |
| OT&E | operational test and evaluation |
| OTA | Operational Test Agency |
| OUSD(R&E) | Office of the Under Secretary of Defense (Research and Engineering) |
| PaaS | platform-as-a-service |
| PED | processing, exploitation, and dissemination |
| PEO | program executive officer |
Suggested Citation:
"Appendix D: Acronyms and Abbreviations." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press.
doi: 10.17226/27092.
| PII | personally identifiable information |
| PMO | Program Management Office |
| QU | quantifiable uncertainty |
| R&D | research and development |
| R&E | research and engineering |
| RADIUS | Research and Development for Image Understanding Systems |
| RAI | responsible AI |
| RAIDEN | Robust AI Development Environment |
| RDT&E | research, development, test, and evaluation |
| RFI | request for information |
| RFP | request for proposal |
| RL | reinforcement learning |
| RLHF | reinforcement learning with human feedback |
| RMF | Risk Management Framework |
| RNN | recurrent neural network |
| SAR | synthetic aperture radar |
| SCSP | Special Competitive Studies Project |
| SDN | software-defined networking |
| SDPE | strategic development planning and experimentation |
| SEI | special experience identifier |
| SME | subject-matter expert |
| SPO | system program office |
| SWAP | size, weight, and power |
| T&E | test and evaluation |
| TEMP | T&E Master Plan |
| TEVV | Test, Evaluation, Verification, and Validation |
| TL | transfer learning |
| TPS | Test Pilot School |
| TQD | training-quality data |
| TRL | technology readiness level |
| TRMC | Test Resource Management Center |
| TW | Test Wing |
| UARC | University-Affiliated Research Center |
| UAS | unmanned aerial system |
| UGV | uncrewed ground vehicle |
| UI/UX | user interface/user experience |
Suggested Citation:
"Appendix D: Acronyms and Abbreviations." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press.
doi: 10.17226/27092.
| UON | urgent operational need |
| USAFWC | United States Air Force Warfare Center |
| USC | University of Southern California |
| USDI | Under Secretary for Defense for Intelligence |
| V&V | verification and validation |
| VENOM | Viper Experimentation and Next-Gen Operations Model |
| VISTA | Variable In-Flight Simulator Aircraft |
| VOC | Visual Object Classes |
| VTTC | Virtual Test and Training Center |
| ZT | zero trust |
Suggested Citation:
"Appendix D: Acronyms and Abbreviations." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press.
doi: 10.17226/27092.
Suggested Citation:
"Appendix D: Acronyms and Abbreviations." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press.
doi: 10.17226/27092.
Suggested Citation:
"Appendix D: Acronyms and Abbreviations." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press.
doi: 10.17226/27092.
Suggested Citation:
"Appendix D: Acronyms and Abbreviations." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press.
doi: 10.17226/27092.
Suggested Citation:
"Appendix D: Acronyms and Abbreviations." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press.
doi: 10.17226/27092.
Suggested Citation:
"Appendix D: Acronyms and Abbreviations." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press.
doi: 10.17226/27092.
Suggested Citation:
"Appendix D: Acronyms and Abbreviations." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press.
doi: 10.17226/27092.
Subscribe to Email from the National Academies
Keep up with all of the activities, publications, and events by subscribing to free updates by email.