Previous Chapter: Appendix A: Statement of Task
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.

B

Public Meeting Agendas

APRIL 22, 2022
KICK-OFF MEETING DAY 1

Executive Session

3:00–3:05 PMWelcome and Introductions
3:05–4:00 PMBias and Conflict of Interest Discussion
Scott Weidman, Deputy Executive Director, Division on Engineering and Physical Sciences

Open Session

4:00–5:00 PMSponsor Remarks
Major General Evan Dertien, Commander, Air Force Test Center
Colonel Keith Roessig, Vice Commander, Air Force Test Center
Air Force Test Center Technical Experts
5:00 PMAdjourn
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.

APRIL 25, 2022
KICK-OFF MEETING DAY 2

Executive Session

11:00 AM–1:00 PMBias and Conflict of Interest Discussion

JUNE 27, 2022
DATA-GATHERING WORKSHOP, DAY 1

Room 208
The Keck Center, 500 Fifth Street, NW
Washington, DC 20001

11:00–11:15 AMWorkshop Welcome and Introductions
11:15 AM–12:00 PMSpeaker: Mr. Jacob Martinez, Technical Director, 47th Cyberspace Test Squadron, United States Air Force
12:00–12:45 PMSpeaker: Mr. David Coppler, Technical Director, 46 Test Squadron, United States Air Force
12:45–1:15 PMLunch Break
1:15–2:00 PMSpeaker: Mr. Marshall Kendrick, 45th Test Squadron, United States Air Force
2:00–2:45 PMSpeaker: Dr. Jane Pinelis, Chief, AI Assurance, Office of the Department of Defense Chief Digital and Artificial Intelligence Officer (CDAO)
2:45–3:15 PMDiscussion and Day 1 Wrap-Up
3:15 PMAdjourn
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.

JUNE 28, 2022
DATA-GATHERING WORKSHOP, DAY 2

Room 208
The Keck Center, 500 Fifth Street, NW
Washington, DC 20001

11:00–11:15 AMWelcome and Recap of Day 1
11:15 AM–12:00 PMSpeaker: Dr. Chad Bieber, Director, T&E Operations, Joint AI Center, Johns Hopkins University Applied Physics Laboratory
12:00–12:30 PMDiscussion: Workshop Day 1 and Future Committee Meetings
12:30–1:15 PMLunch Break
1:15–2:00 PMSpeaker: Olivia Brown, Technical Staff, AI Technology Group, MIT Lincoln Laboratory
2:00–2:45 PMSpeaker: Dr. Michael Wellman, Richard H. Orenstein Division Chair of Computer Science and Engineering and Lynn A. Conway Collegiate Professor of Computer Science and Engineering, University of Michigan
2:45–3:00 PMBreak
3:00–3:45 PMSpeaker: Dr. Thomas Strat, President and CEO, DZYNE Technologies
3:45–4:30 PMSpeaker: Jim Bellingham, Executive Director, Johns Hopkins Institute for Assured Autonomy
4:30–4:45 PMBreak
4:45–5:30 PMSpeaker: Dr. Matt Turek, Deputy Director Information Innovation Office
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
5:30–6:15 PMSpeaker: Dr. Nancy Cooke, Professor and Graduate Program Chair in Human Systems Engineering, Polytechnic School, Arizona State University
6:15–6:30 PMDiscussion and Day 2 Wrap-Up
6:30 PMAdjourn

JUNE 28, 2022
DATA-GATHERING WORKSHOP, DAY 3

Room 208
The Keck Center, 500 Fifth Street, NW
Washington, DC 20001

11:00–11:05 AMWelcome and Recap of Day 2
11:05–11:50 AMSpeaker: Dr. Bin Yu (NAS), Chancellor’s Professor in the Departments of Statistics and Electrical Engineering & Computer Sciences, University of California, Berkeley
11:50 AM–12:35 PMSpeaker: Dr. Nathan VanHoudnos, Senior Machine Learning Research Scientist, Software Engineering Institute
12:35–1:15 PMLunch Break
1:15–2:00 PMSpeaker: Dr. Bruce Draper, Program Manager, Defense Advanced Research Projects Agency
2:00–2:45 PMSpeaker: Mr. Ed Zelnio, Principal Research Physicist, Air Force Research Laboratory
2:45–3:00 PMBreak
3:00–3:45 PMSpeaker: Dr. Eileen Bjorkman, Executive Director, Air Force Test Center
3:45–4:30 PMWorkshop Wrap-Up and Discussion
4:30 PMAdjourn
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.

AUGUST 23, 2022
DATA-GATHERING MEETING #2

11:00–11:10 AMWelcome, Introductions, and Quick Updates
11:10 AM–12:10 PMSpeaker: LCDR Joseph W. Geeseman, Program Manager, Smart Sensor, CDAO Algorithmic Warfare Division
12:10–12:45 PMLunch Break
12:45–1:45 PMSpeaker: Dr. Lori Westerkamp, Air Force Research Laboratory Sensors Directorate
1:45–2:00 PMBreak
2:00–3:00 PMSpeaker: Dr. John Richards, Sandia National Laboratories
3:00–4:30 PMCommittee Discussion: Draft Report Outline, September Meeting, Site Visits, Writing Assignments, Fall Meeting Schedule
4:30 PMAdjourn

SEPTEMBER 28, 2022
DATA-GATHERING MEETING #3, DAY 1

Open Session

11:00 AM–12:00 PMSpeaker: Prof. Yolanda Gil, Senior Director for Major Strategic AI and Data Science Initiatives, Information Sciences Institute, University of Southern California
12:00–12:30 PMLunch Break
12:30–1:30 PMSpeaker: Professor Jeff Schneider, Research Professor, Carnegie Mellon University, Founding Member—Uber Advanced Technologies Group
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
1:30–2:30 PMSpeaker: Dr. Mitch Crosswait, Director of Operational Test and Evaluation Deputy Director of Net-Centric, Space, and Missile Defense Systems
2:30–2:45 PMBreak

Closed Session

2:45–4:30 PMCommittee Writing Session/Discussion
4:30 PMAdjourn

SEPTEMBER 29, 2022
DATA-GATHERING MEETING #3, DAY 2

Open Session

11:00 AM–12:00 PMSpeaker: Mr. Eric Nelson, CTO of Software, Morse Corp.
12:00–12:30 PMLunch Break
12:30–1:30 PMSpeaker: Mr. Neil Serebryany, Founder and CEO, CalypsoAI
1:30–1:45 PMBreak

Closed Session

1:45–4:00 PMCommittee Writing Session/Discussion
4:00 PMAdjourn

NOVEMBER 30, 2022
DATA-GATHERING MEETING #4

1:00–2:00 PMSpeaker: Dr. Riccardo Mariani, VP, Industry Safety, NVIDIA Italy
2:00–3:00 PMCommittee Discussion, Planning, and Writing Session
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
3:00–3:45 PMSpeaker: Col. Tucker “Cinco” Hamilton, Chief of AI Test and Operations, Department of the Air Force Chief Data and AI Office & Commander, 96th Operations Group, Eglin Air Force Base
3:45–5:00 PMCommittee Discussion, Planning, and Writing Session (continued)
5:00 PMAdjourn

DECEMBER 6, 2022
DATA-GATHERING MEETING #5, DAY 1

1:00–1:45 PMCommittee Discussion: Finalizing Writing Assignments, January Writing Meeting Planning, Discussion of the Outline and Draft Sections
1:45–2:45 PMSpeaker: Dr. Nicholas Carlini, Research Scientist, Google Brain
2:45–3:00 PMBreak
3:00–4:00 PMSpeakers: Alex Kotran, Co-Founder and CEO, AI Education Project & Michael Kanaan, Chief of Staff of the U.S. Air Force Fellow at Harvard Kennedy School, AI Education Project Board Member
4:00 PMAdjourn

DECEMBER 7, 2022
DATA-GATHERING MEETING #5, DAY 2

12:30–1:30 PMSpeaker: Michael Cox, Vice President and Chief Architect, NVIDIA
1:30–1:45 PMBreak
1:45–2:30 PMCommittee Discussion, Planning, and Writing Session
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
Page 142
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
Page 143
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
Page 144
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
Page 145
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
Page 146
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
Page 147
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
Page 148
Next Chapter: Appendix C: Committee Member Biographical Information
Subscribe to Emails from the National Academies
Stay up to date on activities, publications, and events by subscribing to email updates.