Previous Chapter: References
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.

Appendix A

Workshop Event Agendas

NATIONAL ACADEMIES OF SCIENCES, ENGINEERING, AND MEDICINE DIVISION OF BEHAVIORAL AND SOCIAL SCIENCES AND EDUCATION COMMITTEE ON NATIONAL STATISTICS

Workshop 3: Approaches to Sharing Blended Data in a 21st Century Data Infrastructure

May 22, 2023, Agenda (Day 1) 10:00a-1:30p EDT

10:00–10:15 am Welcome and Workshop Objectives Jerome P. Reiter, Consensus Panel Chair, Duke University
Cheryl Eavey, National Science Foundation
Robert M. Groves, Oversight Committee Chair for Visioning a 21st Century Data Infrastructure, Georgetown University
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
10:15–10:55 Session 1: Unique Challenges to Privacy and Confidentiality Across the Blended Data Lifecycle
10:15–10:35 Mayank Varia, Boston University
This talk will overview technological approaches to achieve input and output privacy across the data lifecycle and will describe challenges and lessons learned from (both successful and unsuccessful) attempts to apply privacy tech when analyzing blended datasets.
10:35–10:55 Panel/Audience Discussion
10:55–11:45 Session 2: Common Privacy Frameworks and Blended Data
10:55–11:25 Julia Lane, New York University
The focus of the discussion will be on the practical application of the Five Safes in the context of considering both privacy protection and utility. The Advisory Committee on Data for Evidence Building recommended considering both risk and utility in providing access to blended data, and government agencies have developed a variety of different practical approaches. I will discuss the Five Safes as implemented in secure remote access facilities, confidential summary tabulations, and synthetic data. I will describe the practical implementation of each, and what has worked best in different use cases.
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
Chris Culnane, University of Melbourne
Ben Rubinstein, University of Melbourne
The “Five Safes” framework has been adopted by government agencies in Australia, New Zealand, and the UK. The framework aims to manage the risks associated with the release of data derived from personal information. Despite its widespread use, the framework has received little technical or legal analysis. We argue that the Five Safes framework has several fundamental flaws: (1) it is disconnected from existing legal protections; (2) it appropriates notions of safety without requiring the necessary strong technical measures; and (3) it views disclosure risk as static in time and does not require ongoing or repeat assessments. We argue that the Five Safes provide little confidence that data sharing under its framework reflects best practice or adequately serves public interest.
11:25–11:45 Panel/Audience Discussion
11:45–12:00 BREAK
12:00–1:25 Session 3: Current Approaches to Privacy Protection with Blended Data
12:00–12:05 Claire Bowen, Panel Member, Urban Institute
12:05–12:25 Refugees
Timothy Triplett, Urban Institute This talk will describe considerations in increasing data access for the Annual Survey of Refugees—the only robust source of national data on refugees’ progress toward self-sufficiency and integration. Users have requested access to refugee enrollment and geographic relocation data at subregional levels. Currently, these data are not released in public-use data files due to confidentiality concerns.
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
12:25–12:45 Health
Lisa Mirel, National Center for Science and Engineering Statistics
This talk will focus on two areas of safeguarding privacy for blending or analyzing blended data: Privacy-Preserving Record Linkages (PPRL) and synthetic data. The talk will conclude with some final reflections and insights on next steps in this critical field of privacy preservation with blended data.
12:45–1:05 Trade Secrets
Chris Morten, Columbia Law School
The companies that generate and benefit from commercially valuable trade secrets and other “confidential commercial information” often assert that such information cannot be shared responsibly, even with government regulators and noncommercial researchers. This presentation will argue that that view is incorrect. At least some sorts of trade secrets can be shared responsibly, so long as access and use are governed with appropriate legal, institutional, and technical constraints. The presentation will summarize a small but growing number of proposals and ongoing initiatives to share certain trade secrets.
1:05–1:25 Panel/Audience Discussion
1:25–1:30 Wrap-up Day 1
Jerome P. Reiter
, Consensus Panel Chair, Duke University
1:30 pm Adjournment of Open Meeting

May 23, 2023, Agenda (Day 2) 10a–12:30p EDT

10:00–10:05 am Welcome and Workshop Objectives (Day 2)
Jerome P. Reiter
, Consensus Panel Chair, Duke University
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
10:05–11:15 Session 4: In-depth Case Study: Unique Privacy Considerations When Blending Education Data
10:05–10:10 Robert Goerge, Panel Member, University of Chicago
10:10–10:30 Andrew M. Penner, University of California-Irvine This talk will discuss the legal, technical, and perceptual challenges in blending education data. Implications of FERPA and public perceptions of confidentiality protections will be explored. The talk will conclude with a discussion of data ownership as residing with the public, rather than with individuals.
10:30–10:50 Kelly Dauberman, Statistics of Income Office
Paul Arnsberger, Statistics of Income Office This presentation will discuss the partnership between the Department of Education and the IRS Statistics of Income office to produce earnings data for the College Scorecard website. The dataset is a blend of federal student aid recipient data derived from the National Student Loan Data System (NSLDS) and IRS administrative tax records data. The presentation will provide an overview of how the data are obtained, and the implementation and evaluation of differential privacy.
10:50–11:15 Peggy Carr, National Center for Education Statistics Reflections on the prior presentations will be shared. Panel/Audience Discussion
11:15–12:25 Session 5: In-depth Case Study: Unique Privacy Considerations in Blending Financial Services Data
11:15–11:20 Mark Watson, Panel Member, Federal Reserve Bank of Kansas City (formerly)
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
11:20–11:40 Larry Cordell, Federal Reserve Bank of Philadelphia
The Federal Reserve System’s Board and 12 Regional Banks obtain access to a broad array of confidential and public consumer data used in research, analysis, and public presentations. This talk will describe some research studies at the Federal Reserve, which blend consumer data from confidential and public sources. The Risk Assessment, Data Analysis, and Research (RADAR) Group at the FRS, which anonymizes these data to ensure individual privacy, will be emphasized.
11:40–12:00 John W. Towns, National Center for Supercomputing Applications, University of Illinois at Urbana-Champaign
Ensuring appropriate access to useful blended data will require not only physical and software infrastructure, but also human infrastructure—the collaboration of technical experts with users of blended data. This talk will describe some of the challenges and opportunities that exist in the development of the community of technical professionals needed to address this critical element of the ecosystem.
12:00–12:25 Panel/Audience Discussion
12:25–12:30 Wrap-up Day 2
Jerome P. Reiter
, Consensus Panel Chair, Duke University
12:30 pm Adjournment of Open Meeting

May 25, 2023, Agenda (Day 3) 10a–1:30p EDT

10:00–10:05 am Welcome and Workshop Objectives (Day 3)
Jerome P. Reiter
, Consensus Panel Chair, Duke University
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
10:05–11:15 Session 6: In-depth Case Study: Unique Privacy Considerations When Blending Justice System Data
10:05–10:10 Karen Levy, Panel Member, Cornell University
10:10–10:30 Kevin Scott, Bureau of Justice Statistics
Lauren Beatty, Bureau of Justice Statistics For the first time in its collection, the Survey of Prison Inmates requested consent from respondents to link their self-report data with various sources of administrative records. This talk will describe the goals of SPI record linkage, the various sources linked to the survey data, and the approaches used to obtain respondent consent for both the survey and record linkage. The talk will conclude with a discussion of the implementation of respondent consent, and the unique challenge it has posed for future research.
10:30–10:50 Michael Mueller-Smith, University of Michigan
This talk will introduce the Criminal Justice Administrative Records System and the opportunities created from integrating justice data with administrative and survey socio-economic data held by the U.S. Census Bureau. Emphasis will be placed on data access modes in development that seek to minimize risk to both justice-involved individuals and agency data providers.
10:50–11:15 Panel/Audience Discussion
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
11:15–12:20 Session 7: In-depth Case Study: Unique Privacy Considerations in Blending Disaster Data
11:15–11:20 Nick Hart, Panel Member, Data Foundation
11:20–11:40 Julie Waters, FEMA
The mission of the Federal Emergency Management Agency (FEMA) to help people before, during, and after disasters requires that decisions be made within rapid timelines to assist disaster survivors effectively and equitably. This talk will focus on FEMA’s approach to balancing privacy considerations with operational speed when using blended data to inform emergency management decisions, with case studies from recent disasters and lessons learned to inform future approaches.
11:40–12:00 Ed Kearns, First Street Foundation
This presentation will examine some of the existing methods used to provide data to customers for disaster/emergency events. It will also consider potential opportunities to improve infrastructure that creates and disseminates these data, including customer requirements, data product design, dissemination, and the role of disclosure avoidance design and management throughout.
12:00–12:20 Panel/Audience Discussion
12:20–12:30 BREAK
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
12:30–1:25 Session 8: Key Considerations in Protecting Privacy in Blended Data
12:30–12:35 Dan Kifer, Panel Member, The Pennsylvania State University
12:35–12:50 Designing Technical Solutions for Privacy Laws
Kobbi Nissim, Georgetown University
Privacy law and privacy technology are two pillars of privacy protection. However, the interaction between the two approaches exposes significant differences, making it challenging to reason whether systems do or do not provide the level of privacy protection as set by privacy law. We will review some of the gaps that exist between mathematical and legal approaches to privacy, and ongoing efforts to bridge them while maintaining legal and mathematical rigor.
12:50–1:05 Communicating Privacy to the Public
Michael Hawes, Census Bureau
Agencies’ ability to communicate how they safeguard respondent data is critical to their ability to ensure ongoing public trust. As disclosure risks grow, however, so too have the technical complexities of agencies’ statistical confidentiality safeguards. Effective public communication about these methods, their efficacy in safeguarding respondent privacy, and their impact on data use is difficult, but essential. This session will discuss those challenges and offer some recommendations and best practices for agencies to consider, particularly in the context of data products derived from blended data.
1:05–1:25 Panel/Audience Discussion
1:25–1:30 Wrap-up Day 3/Next Steps
Jerome P. Reiter
, Consensus Panel Chair, Duke University
1:30 pm Adjournment of Open Meeting of Workshop Event
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.

This page intentionally left blank.

Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
Page 123
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
Page 124
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
Page 125
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
Page 126
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
Page 127
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
Page 128
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
Page 129
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
Page 130
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
Page 131
Suggested Citation: "Appendix A: Workshop Event Agendas." National Academies of Sciences, Engineering, and Medicine. 2024. Toward a 21st Century National Data Infrastructure: Managing Privacy and Confidentiality Risks with Blended Data. Washington, DC: The National Academies Press. doi: 10.17226/27335.
Page 132
Next Chapter: Appendix B: Biographical Sketches of Workshop Event Presenters
Subscribe to Email from the National Academies
Keep up with all of the activities, publications, and events by subscribing to free updates by email.