Assessment to Enhance Air Force and
Department of Defense Prototyping
for the New Defense Strategy

A WORKSHOP SUMMARY

Norman M. Haller, Rapporteur

Air Force Studies Board

Division on Engineering and Physical Sciences

NATIONAL RESEARCH COUNCIL
                         OF THE NATIONAL ACADEMIES

THE NATIONAL ACADEMIES PRESS

Washington, D.C.

www.nap.edu

THE NATIONAL ACADEMIES PRESS     500 Fifth Street, NW     Washington, DC 20001

NOTICE: The project that is the subject of this report was approved by the Governing Board of the National Research Council, whose members are drawn from the councils of the National Academy of Sciences, the National Academy of Engineering, and the Institute of Medicine.

This is a report of work supported by Grant FA9550-12-1-0413 between the U.S. Air Force and the National Academy of Sciences. Any views expressed in this publication are those of the author(s) and do not necessarily reflect the views of the organizations or agencies that provided support for the project.

International Standard Book Number-13: 978-0-309-29677-9

International Standard Book Number-10: 0-309-29677-3

Copies of this report are available from:

The National Academies Press

500 Fifth Street, NW

Keck 360

Washington, DC 20001

(800) 624-6242 or (202) 334-3313

http://www.nap.edu

Copyright 2013 by the National Academy of Sciences. All rights reserved.

Printed in the United States of America

THE NATIONAL ACADEMIES

Advisers to the Nation on Science, Engineering, and Medicine

The National Academy of Sciences is a private, nonprofit, self-perpetuating society of distinguished scholars engaged in scientific and engineering research, dedicated to the furtherance of science and technology and to their use for the general welfare. Upon the authority of the charter granted to it by the Congress in 1863, the Academy has a mandate that requires it to advise the federal government on scientific and technical matters. Dr. Ralph J. Cicerone is president of the National Academy of Sciences.

The National Academy of Engineering was established in 1964, under the charter of the National Academy of Sciences, as a parallel organization of outstanding engineers. It is autonomous in its administration and in the selection of its members, sharing with the National Academy of Sciences the responsibility for advising the federal government. The National Academy of Engineering also sponsors engineering programs aimed at meeting national needs, encourages education and research, and recognizes the superior achievements of engineers. Dr. C. D. Mote, Jr., is president of the National Academy of Engineering.

The Institute of Medicine was established in 1970 by the National Academy of Sciences to secure the services of eminent members of appropriate professions in the examination of policy matters pertaining to the health of the public. The Institute acts under the responsibility given to the National Academy of Sciences by its congressional charter to be an adviser to the federal government and, upon its own initiative, to identify issues of medical care, research, and education. Dr. Harvey V. Fineberg is president of the Institute of Medicine.

The National Research Council was organized by the National Academy of Sciences in 1916 to associate the broad community of science and technology with the Academy’s purposes of furthering knowledge and advising the federal government. Functioning in accordance with general policies determined by the Academy, the Council has become the principal operating agency of both the National Academy of Sciences and the National Academy of Engineering in providing services to the government, the public, and the scientific and engineering communities. The Council is administered jointly by both Academies and the Institute of Medicine. Dr. Ralph J. Cicerone and Dr. C. D. Mote, Jr., are chair and vice chair, respectively, of the National Research Council.

www.national-academies.org

This page intentionally left blank.

PLANNING COMMITTEE FOR A WORKSHOP ON ASSESSMENT
TO ENHANCE AIR FORCE AND DEPARTMENT OF DEFENSE
PROTOTYPING FOR THE NEW DEFENSE STRATEGY

LESTER L. LYLES, The Lyles Group, Chair

CLAUDE M. BOLTON, JR., Defense Acquisition University

KEITH A. COLEMAN, The Boeing Company

JILL P. DAHLBURG, Naval Research Laboratory

LAWRENCE J. DELANEY, Titan Corporation (retired)

BRIAN K. HERSHBERGER, Lockheed Martin Aeronautics

WILLIAM L. MELVIN, Georgia Tech Research Institute

PAUL D. NIELSEN, Software Engineering Institute

Staff

TERRY J. JAGGERS, Director, Air Force Studies Board

CARTER W. FORD, Program Officer

DIONNA ALI, Research Assistant

AIR FORCE STUDIES BOARD

GREGORY S. MARTIN, GS Martin Consulting, Chair

DONALD C. FRASER, Charles Stark Draper Laboratory (retired), Vice Chair

BRIAN A. ARNOLD, Raytheon Company

CLAUDE M. BOLTON, JR., Defense Acquisition University

STEVEN R.J. BRUECK, University of New Mexico

THOMAS J. BURNS, Independent Consultant

FRANK CAPPUCCIO, Cappuccio and Associates, LLC

BLAISE J. DURANTE, U.S. Air Force (retired)

MICHAEL J. GIANELLI, The Boeing Company (retired)

DANIEL HASTINGS, Massachusetts Institute of Technology

RAYMOND E. JOHNS, JR., U.S. Air Force (retired)

PAUL G. KAMINSKI, Technovation, Inc.

ROBERT LATIFF, R. Latiff Associates

NANCY G. LEVESON, Massachusetts Institute of Technology

MARK J. LEWIS, IDA Science and Technology Policy Institute

LESTER L. LYLES, The Lyles Group

MATT L. MLEZIVA, Wildwood Strategic Concepts

C. KUMAR N. PATEL, Pranalytica, Inc.

GERALD F. PERRYMAN, JR., Independent Consultant

RICHARD V. REYNOLDS, The VanFleet Group, LLC

J. DANIEL STEWART, University of Tennessee

STARNES E. WALKER, University of Hawaii System

DAVID A. WHELAN, The Boeing Company

REBECCA WINSTON, Winston Strategic Management Consulting

Staff

TERRY J. JAGGERS, Director

DIONNA ALI, Research Assistant

GREGORY EYRING, Senior Program Officer

CARTER W. FORD, Program Officer

CHRIS JONES, Financial Manager

MARGUERITE E. SCHNEIDER, Administrative Coordinator

Preface

The committee was honored that so many expert speakers from the U.S. government, government-related entities, industry, and academia were available to discuss in detail their views regarding the very important subject of this 3-day workshop. In addition, the committee was especially pleased that Robert Whalen, a retired industry executive with several decades of experience in advanced technology endeavors, shared his perspectives as our emeritus speaker. The committee also thanks the many guests who contributed immensely to this workshop. Finally, this report has been prepared by the workshop rapporteur as a factual summary of what occurred at the workshop. The planning committee’s role was limited to planning and convening the workshop. The views contained in the report are those of individual workshop participants and do not necessarily represent the views of all workshop participants, the planning committee, or the National Research Council.

Lester L. Lyles, Chair
Planning Committee for a Workshop on Assessment to Enhance Air Force and Department of Defense Prototyping for the New Defense Strategy

This page intentionally left blank.

Acknowledgment of Reviewers

This report has been reviewed in draft form by individuals chosen for their diverse perspectives and technical expertise, in accordance with procedures approved by the National Research Council’s (NRC’s) Report Review Committee. The purpose of this independent review is to provide candid and critical comments that will assist the institution in making its published report as sound as possible and to ensure that the report meets institutional standards for objectivity, evidence, and responsiveness to the study charge. The review comments and draft manuscript remain confidential to protect the integrity of the deliberative process. We wish to thank the following individuals for their review of this report:

Jill P. Dahlburg, Naval Research Laboratory,

Paul G. Kaminski, Technovation, Inc.,

Gregory S. Martin, GS Martin Consulting, and

Paul D. Nielsen, Software Engineering Institute.

Although the reviewers listed above have provided many constructive comments and suggestions, they were not asked to endorse the views presented at the workshop, nor did they see the final draft of the workshop summary before its release. The review of this workshop summary was overseen by Stephen M. Robinson, University of Wisconsin-Madison. Appointed by the NRC, he was responsible for making certain that an independent examination of this workshop summary was carried out in accordance with institutional procedures and that all review comments were carefully considered. Responsibility for the final content of this summary rests entirely with the author and the institution.

This page intentionally left blank.

Contents

1   INTRODUCTION

2   OVERVIEW

Theme 1. Prototyping and Its Many Definitions

Theme 2. The Value of Prototyping

Theme 3. Tying Prototyping to Strategy

Theme 4. Prototyping as an Agent for Change

Theme 5. Prototyping as a Versatile Tool

Theme 6. Prototyping as a Means to Empower People

Theme 7. Funds and Incentives for Prototyping

Theme 8. A Technology Development Strategy

APPENDIXES

A   Biographical Sketches of Committee Members

B   Terms of Reference

C   Workshop Agenda

D   Workshop Participants

E   Speaker Abstracts

This page intentionally left blank.

Acronyms

This page intentionally left blank.