Previous Chapter: Appendix A: Statement of Task
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.

B

Public Meeting Agendas

APRIL 22, 2022
KICK-OFF MEETING DAY 1

Executive Session

3:00–3:05 PM Welcome and Introductions
3:05–4:00 PM Bias and Conflict of Interest Discussion
Scott Weidman, Deputy Executive Director, Division on Engineering and Physical Sciences

Open Session

4:00–5:00 PM Sponsor Remarks
Major General Evan Dertien, Commander, Air Force Test Center
Colonel Keith Roessig, Vice Commander, Air Force Test Center
Air Force Test Center Technical Experts
5:00 PM Adjourn
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.

APRIL 25, 2022
KICK-OFF MEETING DAY 2

Executive Session

11:00 AM–1:00 PM Bias and Conflict of Interest Discussion

JUNE 27, 2022
DATA-GATHERING WORKSHOP, DAY 1

Room 208
The Keck Center, 500 Fifth Street, NW
Washington, DC 20001

11:00–11:15 AM Workshop Welcome and Introductions
11:15 AM–12:00 PM Speaker: Mr. Jacob Martinez, Technical Director, 47th Cyberspace Test Squadron, United States Air Force
12:00–12:45 PM Speaker: Mr. David Coppler, Technical Director, 46 Test Squadron, United States Air Force
12:45–1:15 PM Lunch Break
1:15–2:00 PM Speaker: Mr. Marshall Kendrick, 45th Test Squadron, United States Air Force
2:00–2:45 PM Speaker: Dr. Jane Pinelis, Chief, AI Assurance, Office of the Department of Defense Chief Digital and Artificial Intelligence Officer (CDAO)
2:45–3:15 PM Discussion and Day 1 Wrap-Up
3:15 PM Adjourn
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.

JUNE 28, 2022
DATA-GATHERING WORKSHOP, DAY 2

Room 208
The Keck Center, 500 Fifth Street, NW
Washington, DC 20001

11:00–11:15 AM Welcome and Recap of Day 1
11:15 AM–12:00 PM Speaker: Dr. Chad Bieber, Director, T&E Operations, Joint AI Center, Johns Hopkins University Applied Physics Laboratory
12:00–12:30 PM Discussion: Workshop Day 1 and Future Committee Meetings
12:30–1:15 PM Lunch Break
1:15–2:00 PM Speaker: Olivia Brown, Technical Staff, AI Technology Group, MIT Lincoln Laboratory
2:00–2:45 PM Speaker: Dr. Michael Wellman, Richard H. Orenstein Division Chair of Computer Science and Engineering and Lynn A. Conway Collegiate Professor of Computer Science and Engineering, University of Michigan
2:45–3:00 PM Break
3:00–3:45 PM Speaker: Dr. Thomas Strat, President and CEO, DZYNE Technologies
3:45–4:30 PM Speaker: Jim Bellingham, Executive Director, Johns Hopkins Institute for Assured Autonomy
4:30–4:45 PM Break
4:45–5:30 PM Speaker: Dr. Matt Turek, Deputy Director Information Innovation Office
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
5:30–6:15 PM Speaker: Dr. Nancy Cooke, Professor and Graduate Program Chair in Human Systems Engineering, Polytechnic School, Arizona State University
6:15–6:30 PM Discussion and Day 2 Wrap-Up
6:30 PM Adjourn

JUNE 28, 2022
DATA-GATHERING WORKSHOP, DAY 3

Room 208
The Keck Center, 500 Fifth Street, NW
Washington, DC 20001

11:00–11:05 AM Welcome and Recap of Day 2
11:05–11:50 AM Speaker: Dr. Bin Yu (NAS), Chancellor’s Professor in the Departments of Statistics and Electrical Engineering & Computer Sciences, University of California, Berkeley
11:50 AM–12:35 PM Speaker: Dr. Nathan VanHoudnos, Senior Machine Learning Research Scientist, Software Engineering Institute
12:35–1:15 PM Lunch Break
1:15–2:00 PM Speaker: Dr. Bruce Draper, Program Manager, Defense Advanced Research Projects Agency
2:00–2:45 PM Speaker: Mr. Ed Zelnio, Principal Research Physicist, Air Force Research Laboratory
2:45–3:00 PM Break
3:00–3:45 PM Speaker: Dr. Eileen Bjorkman, Executive Director, Air Force Test Center
3:45–4:30 PM Workshop Wrap-Up and Discussion
4:30 PM Adjourn
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.

AUGUST 23, 2022
DATA-GATHERING MEETING #2

11:00–11:10 AM Welcome, Introductions, and Quick Updates
11:10 AM–12:10 PM Speaker: LCDR Joseph W. Geeseman, Program Manager, Smart Sensor, CDAO Algorithmic Warfare Division
12:10–12:45 PM Lunch Break
12:45–1:45 PM Speaker: Dr. Lori Westerkamp, Air Force Research Laboratory Sensors Directorate
1:45–2:00 PM Break
2:00–3:00 PM Speaker: Dr. John Richards, Sandia National Laboratories
3:00–4:30 PM Committee Discussion: Draft Report Outline, September Meeting, Site Visits, Writing Assignments, Fall Meeting Schedule
4:30 PM Adjourn

SEPTEMBER 28, 2022
DATA-GATHERING MEETING #3, DAY 1

Open Session

11:00 AM–12:00 PM Speaker: Prof. Yolanda Gil, Senior Director for Major Strategic AI and Data Science Initiatives, Information Sciences Institute, University of Southern California
12:00–12:30 PM Lunch Break
12:30–1:30 PM Speaker: Professor Jeff Schneider, Research Professor, Carnegie Mellon University, Founding Member—Uber Advanced Technologies Group
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
1:30–2:30 PM Speaker: Dr. Mitch Crosswait, Director of Operational Test and Evaluation Deputy Director of Net-Centric, Space, and Missile Defense Systems
2:30–2:45 PM Break

Closed Session

2:45–4:30 PM Committee Writing Session/Discussion
4:30 PM Adjourn

SEPTEMBER 29, 2022
DATA-GATHERING MEETING #3, DAY 2

Open Session

11:00 AM–12:00 PM Speaker: Mr. Eric Nelson, CTO of Software, Morse Corp.
12:00–12:30 PM Lunch Break
12:30–1:30 PM Speaker: Mr. Neil Serebryany, Founder and CEO, CalypsoAI
1:30–1:45 PM Break

Closed Session

1:45–4:00 PM Committee Writing Session/Discussion
4:00 PM Adjourn

NOVEMBER 30, 2022
DATA-GATHERING MEETING #4

1:00–2:00 PM Speaker: Dr. Riccardo Mariani, VP, Industry Safety, NVIDIA Italy
2:00–3:00 PM Committee Discussion, Planning, and Writing Session
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
3:00–3:45 PM Speaker: Col. Tucker “Cinco” Hamilton, Chief of AI Test and Operations, Department of the Air Force Chief Data and AI Office & Commander, 96th Operations Group, Eglin Air Force Base
3:45–5:00 PM Committee Discussion, Planning, and Writing Session (continued)
5:00 PM Adjourn

DECEMBER 6, 2022
DATA-GATHERING MEETING #5, DAY 1

1:00–1:45 PM Committee Discussion: Finalizing Writing Assignments, January Writing Meeting Planning, Discussion of the Outline and Draft Sections
1:45–2:45 PM Speaker: Dr. Nicholas Carlini, Research Scientist, Google Brain
2:45–3:00 PM Break
3:00–4:00 PM Speakers: Alex Kotran, Co-Founder and CEO, AI Education Project & Michael Kanaan, Chief of Staff of the U.S. Air Force Fellow at Harvard Kennedy School, AI Education Project Board Member
4:00 PM Adjourn

DECEMBER 7, 2022
DATA-GATHERING MEETING #5, DAY 2

12:30–1:30 PM Speaker: Michael Cox, Vice President and Chief Architect, NVIDIA
1:30–1:45 PM Break
1:45–2:30 PM Committee Discussion, Planning, and Writing Session
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
Page 142
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
Page 143
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
Page 144
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
Page 145
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
Page 146
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
Page 147
Suggested Citation: "Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
Page 148
Next Chapter: Appendix C: Committee Member Biographical Information
Subscribe to Email from the National Academies
Keep up with all of the activities, publications, and events by subscribing to free updates by email.