Appendix C

Workshop on Developing Science, Technology, and Innovation Indicators for the Future Agenda and Participants*

AGENDA

This workshop is part of a study by the Panel on Developing Science, Technology, and Innovation Indicators for the Future. During this two-day meeting, scholars and practitioners from around the world will discuss specific datasets, frameworks, methods, and tools for measuring science, technology and innovation (STI) activities at the national and subnational levels, and for developed and developing countries. Participants will discuss (1) metrics that have been shown to track changes in national economic growth, productivity, and other indicators of social development; (2) frameworks for gathering data on academic inputs to research, development, and translation processes toward commercialization of new scientific outputs, with specific regional outlooks; and (3) next-generation methods for gathering and disseminating data that give snapshot views of scientific research and innovation in sectors such as biotechnology and information and communication technology (ICT). Presentations and networked discussions will focus attention on the policy relevance of redesigned or new indicators.

DAY 1: Monday, July 11, 2011

8:00-9:00 AM	REGISTRATION IN LOBBY (breakfast available in main foyer)
9:00-9:10	WELCOME AND OVERVIEW
	Cochairs: Robert Litan (Kauffman Foundation) and Andrew Wyckoff (OECD)
	Connie Citro (Committee on National Statistics, National Research Council) Steve Merrill (Board on Science, Technology, and Economic Policy, National Research Council)
9:10-10:35	SESSION I: NEXT-GENERATION STI STATISTICS—FRAMEWORKS AND DATA
	Objective: Identify what the federal statistical system can produce now regarding STI trends. Specific measures of business and university inputs and outputs and related outcomes and impacts are welcomed. What can be done now with existing surveys and administrative data? What do users want that requires new methods of gathering and disseminating data (types of data, linkages of agency surveys and periodicity)? What should NCSES produce to meet demand?
	Chair: Bob Litan (Kauffman Foundation)
	Discussant: John Rolph (University of Southern California) Presenters:
	John Haltiwanger (University of Maryland) Alicia Robb (Kauffman Foundation) Stefano Bertuzzi (National Institutes of Health, STAR METRICS) Matthieu Delescluse (European Commission)
10:35-10:45	BREAK (refreshments available in lobby)

____________________

^*All listed affiliations are as of July 2011.

10:45-12:45 PM	SESSION II: INTERNATIONAL STI INDICATORS—RECENT DEVELOPMENTS
	Objective: Identify recent developments in measuring STI and what is currently planned for the future.
	Discussion should reveal what has been successfully and unsuccessfully measured. What are critical bottlenecks and perceived opportunities? Policy relevance of indicators is key. What global STI metrics and indicators should NCSES develop in the near and medium terms (the next 5-10 years)?
	Chair: Michael Mandel (University of Pennsylvania)
	Discussant: Andrew Wyckoff (OECD)
	Presenters:
	Jonathan Haskel (Imperial College Business School, U.K.) Brian MacAulay (National Endowment for Science, Technology and the Arts, U.K.) Hugo Hollanders (United Nations University-Maastricht Economic and Social Research Institute on Innovation and Technology [UNU-MERIT], Netherlands) Shinichi Akaike (Institute of Innovation Research, Hitotsubashi University, Japan) Cheonsik Woo (Korean Development Institute)
12:45-1:45	LUNCH (in main foyer)
1:45-3:45	SESSION III: NEXT-GENERATION STI STATISTICS—FRONTIER METHODS
	Objective: Identify frameworks and tools beyond survey instruments that yield measurements of research and commercialization productivity. Details on how a statistical agency can utilize these tools are key. Education and workforce indicators are needed. Which tools are ripe for application that NCSES should use to produce new STI indicators?
	Chair: Geoff Davis (Google)
	Discussant: Richard Freeman (Harvard University)
	Presenters:
	Erik Brynjolfsson (Massachusetts Institute of Technology) Lee Giles (Penn State University) Carl Bergstrom (University of Washington) Richard Price (Academia.edu)
3:45-4:00	BREAK (refreshments available in lobby)
4:00-5:00	SESSION IV: ROUNDTABLE: INDUSTRY, ACADEMIC, AND GOVERNMENT PERSPECTIVES
	Objective: Identify what firms, universities, and statistical agencies can be expected to contribute to data inputs for STI indicators. Determine new uses for STI indicators at firms, particularly multinationals. Establish what policy makers and university sponsored research officers/technology transfer managers need to know in their respective decision-making processes. Where will the indicators be used and why, and why have they not already been developed? What are the new data inputs and new statistical outputs that should be the laser focus for NCSES in the next 5-10 years?
	Chairs: Barbara Fraumeni (University of Southern Maine)
	Discussants:
	Nick Donofrio (IBM) Richard Freeman (Harvard University) David Goldston (Natural Resources Defense Council)
5:00-5:10	WRAP-UP
	Cochairs: Robert Litan and Andrew Wyckoff Study Director: Kaye Husbands Fealing (National Academies/ Committee on National Statistics)
5:30-7:00	RECEPTION (in main foyer)
7:00 pm	ADJOURN

DAY 2: Tuesday, July 12, 2011

8:00 -8:30 AM	REGISTRATION IN LOBBY (breakfast available in main foyer)
8:30 -10:30	SESSION V: INTERNATIONAL STI INDICATORS—NEW REGIONS
	Objective: Identify new foci for STI indicator initiatives. Includes presentations on emerging economies’ measurement of STI diffusion and impacts. Discussion of service-sector measures and measures of design activities. What indicators should NCSES develop to measure technological diffusion and design?
	Chair: Carl Dahlman (Georgetown University)
	Discussant: Fred Gault (UNU-MERIT)
	Presenters:
	Howard Alper (University of Ottawa, Canada) Changlin Gao (Chinese Academy of Science and Technology for Development) Philippe Mawoko (The New Partnership for Africa’s Development [NEPAD], South Africa) Gustavo Crespi (Inter-American Development Bank, Uruguay) Jayanta Chatterjee (Indian Institute of Technology-Kanpur)
10:30-10:45	BREAK (refreshments available in lobby)
10:45-12:30 PM	SESSION VI: SUBNATIONAL STI INDICATORS
	Objective: Identify state and regional indicators of entrepreneurial activities and hot spots of innovation.
	What indicators should NCSES develop to measure state and regional STI and diffusion activities?
	Chair: Lee Wilkinson (SYSTAT)
	Discussant: David Goldston (Natural Resources Defense Council)
	Presenters:
	Andrew Reamer (George Washington University) Robert Atkinson (Information Technology and Innovation Foundation) Maryann Feldman (University of North Carolina) David Winwood (University of Alabama-Birmingham Research Foundation)/Robert Samors (Association of Public and Land-grant Universities [APLU], by telephone)
12:30-12:40	Wrap-up
	Cochairs: Robert Litan and Andrew Wyckoff
12:40-2:00	LUNCH (in main foyer)
2:00 pm	ADJOURN

PARTICIPANTS

Panel Members

Robert E. Litan (Cochair), The Ewing Marion Kauffman Foundation

Andrew W. Wyckoff (Cochair), OECD, Paris

Carl J. Dahlman, Georgetown University

Geoff Davis, Google, Inc.

Barbara M. Fraumeni, University of Southern Maine

Richard B. Freeman, Harvard University

Fred Gault, United Nations University-Maastricht Economic and Social Research Institute on Innovation and Technology, The Netherlands

David Goldston, Natural Resources Defense Council

Michael Mandel, University of Pennsylvania

John E. Rolph, University of Southern California

Leland Wilkinson, SYSTAT Software, Inc.

Presenters

Shinichi Akaike, Hitotsubashi University, Japan

Howard Alper, Canada’s Science, Technology, and Innovation Council

Rob Atkinson, Information Technology and Innovation Foundation

Carl Bergstrom, University of Washington

Stefano Bertuzzi, National Institutes of Health

Eric Brynjolfsson, Massachusetts Institute of Technology

Jayanta Chatterjee, Indian Institute of Technology, Kanpur, India

Gustavo Crespi, Inter-American Development Bank

Matthieu Delescluse, European Commission, Brussels, Belgium

Nick Donofrio, IBM

Maryann Feldman, University of North Carolina

Changlin Gao, Chinese Academy of Science and Technology, Beijing, China

Lee Giles, Penn State University

John Haltiwanger, University of Maryland

Jonathan Haskel, Imperial College Business School, United Kingdom

Hugo Hollanders, Maastrict University, The Netherlands

Brian MacAulay, National Endowment for Science, Technology and the Arts, United Kingdom

Philippe Mawoko, The New Partnership for Africa’s Development (NEPAD), Pretoria, South Africa

Richard Price, Academia.edu

Andrew Reamer, George Washington University

Alicia Robb, The Ewing Marion Kauffman Foundation

Robert Samors (by telephone), Association of Public and Land-grant Universities

David Winwood, Association of Public and Land-grant Universities

Guests

Ana Aizcorbe, U.S. Bureau of Economic Analysis

Jeff Alexander, SRI International

Gary Anderson, Jr., National Institute of Standards and Technology

Clara Asmail, National Institute of Standards and Technology

B.K. Atrostic, U.S. Census Bureau

David Ballard, GRA, Inc.

David Beede, U.S. Department of Commerce

Bob Bell, National Center for Science and Engineering Statistics, National Science Foundation

Brittany Bond, U.S. Department of Commerce

Patrice Bourdelais, Centre National de la Récherche Scientifique

Paul Bugg, U.S. Office of Management and Budget

Lynda Carlson, National Center for Science and Engineering Statistics, National Science Foundation

Carolyn Carroll, STAT TECH, Inc.

Arthur Cho, Japan Science and Technology Agency

Carol Corrado, Georgetown Center for Business and Public Policy

Louis Marc Ducharme, Statistics Canada

Louise Earl, Statistics Canada

Uchenna Egenti, East Tennessee State University

Jonathan Epstein, U.S. Senate

Paul Fakes, American Society for Mechanical Engineers

Chris Fall, U.S. Military

Jean Favero, Centre National de la Récherche Scientifique

Lauren Gilchrist, Center for Regional Economic Competitiveness

Stuart Graham, U.S. Patent and Trademark Office

Myron Gutmann, Directorate for the Social, Behavioral, and Economic Sciences, National Science Foundation

John Hall, PA Alliance for STEM Education

Kim Hamilton, U.S. Patent Board

Lee Herring, Office of Legislative and Public Affairs, National Science Foundation

Robert Hershey, Capital PC User Group

Chris Hill, George Mason University

Richard Hough, U.S. Census Bureau

Tommy Hudzik, Independent Consultant

Charles Hulten, University of Maryland

Elmer Iglesias, U.S. Department of Commerce

Takashi Inutsuka, Science Counselor, Embassy of Japan

John Jankowski, National Center for Science and Engineering Statistics, National Science Foundation

Ken Jarboe, Athena Alliance

Richard Johnson, Global Helix, LLC

David Kahaner, Asian Technology Information Program

Nimmi Kannankutty, National Center for Science and Engineering Statistics, National Science Foundation

Michael Kehoe, American Association for the Advancement of Science

Todd Kuiken, Woodrow Wilson International Center for Scholars

Karen Laney, U.S. International Trade Commission

Chuck Larson, Innovation Research International

Marc Legault, Science, Technology, and Innovation Council, Canada

Rolf Lehming, National Center for Science and Engineering Statistics, National Science Foundation

Wendy Li, U.S. Bureau of Economic Analysis

Ying Lowrey, U.S. Small Business Administration

Shelley Martinez, U.S. Office of Management and Budget

Tony Mazzaschi, Association of American Medical Colleges

Christine McDonald, U.S. Office of Management and Budget

Javier Miranda, U.S. Census Bureau

T.C. Moore, Independent Consultant

Francisco Moris, National Center for Science and Engineering Statistics, National Science Foundation

Paul Morris, National Center for Science and Engineering Statistics, National Science Foundation

Manuel Mota, Massachusetts Institute of Technology

Jeri Mulrow, National Center for Science and Engineering Statistics, National Science Foundation

Vinh Nguyen, Independent Consultant

Kimberly Noonan, National Center for Science and Engineering Statistics, National Science Foundation

Pamela O’Neil, National Center for Science and Engineering Statistics, National Science Foundation

Takashi Ohama, Japan Science and Technology Agency

Sumiya Okubo, Independent Consultant

Erik Pages, EntreWorks Consulting

Diane Palmintera, Innovation Associates

Sapun Parekh, National Science Foundation

Jongwon Park, SRI International

Joel Parriott, U.S. Office of Management and Budget

Sebastian Pfotenhauer, Massachusetts Institute of Technology

Pallivi Phartiyal, American Association for the Advancement of Science

Brian Reinhardt, Defense Threat Reduction Agency

Sally Rood, Science Policy Works International

Robert Shelton, World Technology Evaluation Center, Inc.

Stephanie Shipp, IDA Science and Technology Policy Institute

Debbie Stine, President’s Council of Advisors on Science and Technology

Andrea Stith, International Higher Education and Science

Ezequiel Tacsir, Inter-American Development Bank

Greg Tassey, National Institute of Standards and Technology

Chris Thomas, Independent Consultant

Hua Tian, Arizona State University

James Tsang, Independent Consultant

Nick Vonortas, George Washington University

Philip Webre, Congressional Budget Office

Brittany Westlake, American Chemical Society

Jeremy Wise, U.S. International Trade Commission

Tim Wojan, U.S. Department of Agriculture

Rieko Yajima, American Association for the Advancement of Science

Arthur Yong Yeung Cho, Japan Science and Technology Agency

Pluvia Zuniga, United Nations University-Maastricht Economic and Social Research Institute on Innovation and Technology

NRC Staff

Connie Citro, Committee on National Statistics

Gail Greenfield, Policy and Global Affairs

Kaye Husbands Fealing, Committee on National Statistics

Anthony Mann, Committee on National Statistics

Steve Merrill, Board on Science, Technology, and Economic Policy

Miron Straf, Division of Behavioral and Social Sciences and Education

This page intentionally left blank.