Enhancing Scientific Reproducibility through Transparent Reporting: A Workshop

Workshop

Download PDF

Paperback - $52.20
Ebook - $42.29

Request an exam or desk copy

Sharing knowledge is what drives scientific progress - each new advance or innovation in biomedical research builds on previous observations. However, for experimental findings to be broadly accepted as credible by the scientific community, they must be verified by other researchers. An essential step is for researchers to report their findings in a manner that is understandable to others in the scientific community and provide sufficient information for others to validate the original results and build on them. In recent years, concern has been growing over a number of studies that have failed to replicate previous results and evidence from larger meta-analyses, which have pointed to the lack of reproducibility in biomedical research.

On September 25 and 26, 2019, the National Academies of Science, Engineering, and Medicine hosted a public workshop in Washington, DC, to discuss the current state of transparency in the reporting of preclinical biomedical research and to explore opportunities for harmonizing reporting guidelines across journals and funding agencies. Convened jointly by the Forum on Drug Discovery, Development, and Translation; the Forum on Neuroscience and Nervous System Disorders; the National Cancer Policy Forum; and the Roundtable on Genomics and Precision Health, the workshop primarily focused on transparent reporting in preclinical research, but also considered lessons learned and best practices from clinical research reporting. This publication summarizes the presentation and discussion of the workshop.

Additional materials

Infographic: Enhancing Scientific Reproducibility in Biomedical Research Through Transparent Reporting

Publication information

142 pages · 6 x 9 · paperback
ISBN Paperback: 0-309-66349-0
ISBN Ebook: 0-309-66350-4
DOI: https://doi.org/10.17226/25627

Suggested citation

National Academies of Sciences, Engineering, and Medicine. 2020. Enhancing Scientific Reproducibility in Biomedical Research Through Transparent Reporting: Proceedings of a Workshop. Washington, DC: The National Academies Press.

Import this citation to:

Harvey V. Fineberg

Harvey V. Fineberg is the president of the Gordon and Betty Moore Foundation, which fosters path-breaking scientific discovery, environmental conservation, improvements in patient care and preservation of the special character of the San Francisco Bay Area. He previously held the Presidential Chair for 2014-2015 as visiting professor at the University of California, San Francisco. Prior to that, he served as president of the Institute of Medicine from 2002 to 2014 and as provost of Harvard University from 1997 to 2001, following 13 years as dean of the Harvard School of Public Health. He has devoted most of his academic career to the fields of health policy and medical decision-making. His past research has focused on the process of policy development and implementation, assessment of medical technology, evaluation and use of vaccines, and dissemination of medical innovations. Fineberg chairs the board of the Carnegie Endowment for International Peace and serves on the boards of the William and Flora Hewlett Foundation and the China Medical Board. He helped found and served as president of the Society for Medical Decision Making and also served as consultant to the World Health Organization. Fineberg is co-author of the books Clinical Decision Analysis, Innovators in Physician Education and The Epidemic That Never Was, an analysis of the controversial federal immunization program against swine flu in 1976. He has co-edited several books on such diverse topics as AIDS prevention, vaccine safety, understanding risk in society and global health. He has also authored numerous articles published in professional journals. Fineberg is the recipient of several honorary degrees—the Frank A. Calderone Prize in Public Health, the Henry G. Friesen International Prize in Health Research and the Harvard Medal, awarded by the alumni association of the university from which he earned his bachelor’s and doctoral degrees.

Barry S. Coller

Dr. Coller serves as Physician in Chief, Vice President for Medical Affairs and the David Rockefeller Professor at The Rockefeller University. An authority on the cardiovascular biology of integrins and TGF-beta, Dr. Coller is a member of the Institute of Medicine, the National Academy of Sciences and was founding president of the Society for Clinical and Translational Science. Dr. Coller is a pioneer in the discovery and development of monoclonal antibodies for use as human therapeutics. He played the central role in discovering the active component and mechanism of abciximab (ReoPro(R)), and he was a leader in its subsequent clinical development resulting in one of the first FDA approvals of and antibody medicine. He has been a Member of Scientific Advisory Board at Scholar Rock, Inc. since September 2014.

Stuart W. Hoffman

Dr. Hoffman is the point of contact for VA/Rehabilitation R&D on traumatic brain injury research. In this role, Dr. Hoffman has oversight for two VA TBI Research Centers and is the Co-chair of the Government Steering Committee for the VA/DoD Chronic Effects of Neurotrauma Consortium, as well as a the VA TBI subject matter expert for the National Research Action Plan for Improving Access to Mental Health Services for Veterans, Service Members, and Military Families. Dr. Hoffman also serves on several intra- and interagency advisory committees for VA and DoD, including the Congressionally-mandated Traumatic Brain injury Advisory Committee for the Veterans Health Administration. Dr. Hoffman received his doctoral degree in behavioral and molecular neuroscience at Rutgers University in 1995 and completed his postdoctoral training in pharmacology at Virginia Commonwealth University in 1997. Dr. Hoffman’s professional career began at Emory University as a Research Assistant Professor in the Department of Neurology in 1998 and was an Assistant Professor of Emergency Medicine from 2000 to 2006. Immediately prior to joining the VA in 2010, Dr. Hoffman was the Research Director for the Defense and Veterans Brain Injury Center in Johnstown, Pennsylvania. Dr. Hoffman has more than 30 years of translational neuroscience research experience that focused on neuroprotection and methods to promote recovery of function after brain injury.

Veronique Kiermer

Dr. Kiermer is Executive Editor at the Public Library of Science (PLOS), where she works closely with the editorial teams of the seven PLOS journals to continually improve the communication of research. Before joining PLOS in 2015, she was Executive Editor and Director of Author and Reviewer Services for Nature Publishing Group. In that capacity she oversaw editorial and research integrity policies across the Nature journals. She started her career in publishing as the founding Chief Editor of Nature Methods and subsequently took on publishing responsibility for the title and other online products. Véronique has a PhD in molecular biology from the Université Libre de Bruxelles, Belgium. Her postdoctoral work was in the laboratory of Dr. Eric Verdin at the Gladstone Institute, University of California, San Francisco, studying the transcriptional regulation of HIV. She worked on gene therapy projects at the biotechnology company Cell Genesys before moving into publishing in 2004. Since February 2017, she serves as Chair of the ORCID Board.

Benedict Kolber

Dr. Kolber serves as an Associate Professor in the Department of Biological Sciences and the Research and Education Coordinator for the Chronic Pain Research Consortium. Dr. Kolber came to Duquesne in 2011 from Washington University in St. Louis. Dr. Kolber has over 15 years experience doing neuroscience research. His graduate work with Dr. Louis Muglia, M.D., Ph.D. looked at the role of the endocrine stress response in the modulation of stress adaptation, depression, and anxiety. His post-doctoral work with Dr. Robert Gereau IV, Ph.D. focused on understanding the role of the amygdala in the modulation of acute and chronic pain. Dr. Kolber also has extensive experience teaching at the undergraduate and graduate level. His teaching interests focus on teaching neuroscience, endocrinology, physiology, and in utilizing innovative teaching techniques in the classroom.

Alexa T. McCray

Dr. McCray is Professor of Medicine at Harvard Medical School and the Department of Medicine, Beth Israel Deaconess Medical Center. She conducts research on knowledge representation and discovery, with a special focus on the significant problems that persist in the curation, dissemination, and exchange of scientific and clinical information in biomedicine and health. McCray is the former director of the Lister Hill National Center for Biomedical Communications, a research division of the National Library of Medicine at the National Institutes of Health. While at the NIH, she directed the design and development of a number of national information resources, including ClinicalTrials.gov. Before joining the NIH she was on the research staff of IBM’s T.J. Watson Research Center. She received the PhD from Georgetown University, and for three years was on the faculty there. She conducted pre-doctoral research at the Massachusetts Institute of Technology. McCray joined Harvard Medical School in 2005, where she was founding co-director of the Center for Biomedical Informatics and associate director of the Francis A. Countway Library of Medicine. McCray was elected to the National Academy of Medicine in 2001. She is chair of the National Research Council’s Board on Research Data and Information. She is a fellow of the American Association for the Advancement of Science, a fellow of the American College of Medical Informatics (ACMI), an honorary fellow of the International Medical Informatics Association, and a founding fellow of the International Academy of Health Sciences Informatics. She is a past president of ACMI and a past member of the board of both the American Medical Informatics Association and the International Medical Informatics Association. She is a former editor-in-chief of Methods of Information in Medicine, and she is a past member of the editorial board of the Journal of the American Medical Informatics Association. She chaired the 2018 National Academies of Sciences, Engineering, and Medicine consensus study entitled Open Science by Design: Realizing a Vision for 21st Century Research.

Jill P. Mesirov

As associate vice chancellor for computational health sciences, Jill Mesirov, PhD, is responsible for the overarching strategy for data science and research computing for health sciences at UC San Diego School of Medicine. She is also a professor in the Department of Medicine. Dr. Mesirov is a computational scientist who has spent many years working in the area of high-performance computing on problems that arise in science, engineering, and business applications. Her research focuses on cancer genomics applying machine-learning methods to functional data derived from patient tumors. The lab analyzes this molecular data to determine the underlying biological mechanisms of specific tumor subtypes, to stratify patients according to their relative risks of relapse, and to identify candidate compounds for new treatments. In addition, Dr. Mesirov is committed to the development of practical, accessible software tools to bring these methods to the general biomedical research community. Her tools support almost 500,000 users worldwide.
Before joining UC San Diego in 2015, Dr. Mesirov was associate director and chief informatics officer at the Broad Institute of MIT and Harvard, where she directed the Computational Biology and Bioinformatics Program. She previously served as manager of computational biology and bioinformatics in the Healthcare/Pharmaceutical Solutions Organization, director of research at Thinking Machines Corporation, and has also held positions in the mathematics department at the University of California, Berkeley and served as associate executive director of the American Mathematical Society.
Dr. Mesirov received her BA in mathematics from the University of Pennsylvania and earned her MA and PhD in mathematics from Brandeis University.
She is a fellow of the American Association for the Advancement of Science (AAAS), the American Mathematical Society (AMS), the Association for Women in Mathematics, and the International Society for Computational Biology (ISCB).

Martin J. Murphy

Dr. Murphy is a member of the National Cancer Policy Forum of the National Academy of Medicine of the National Academy of Sciences; a Director of the Foundation for the National Institutes of Health. He is a Fellow of the American Society of Clinical Oncology, and founding Executive Editor of the peer-reviewed biomedical journal: The Oncologist, Stem Cells and Stem Cells Translational Medicine. A co-founder of the Society for Translational Oncology; a member of the Scientific Advisory Board of Hatteras Venture Partners; a charter member of the International Advisory Board of the VU University Medical Imaging Center; a charter member of Queen’s University Belfast School of Medicine International Review Board; Dr. Murphy is also Chairman Emeritus of the Conquer Cancer Foundation of the American Society of Clinical Oncology (ASCO); convener of ACT-China; and a steering committee member and senior consultant to the Chinese Society of Clinical Oncology. Dr. Murphy is founding CEO of Project Data Sphere®, LLC, a non-profit enterprise devoted to cancer clinical trial data-transparency, data-sharing and data-analysis founded by the CEO Roundtable on Cancer’s Life Sciences Consortium.

Richard Nakamura

In 2013, Dr. Richard Nakamura was named Director of the Center for Scientific Review (CSR) at the National Institutes of Health (NIH). He leads CSR’s 450 scientists and administrative staff, overseeing their efforts to manage 80,000 incoming NIH grant applications a year and review the majority of them in CSR peer review groups. CSR holds about 1,500 review meetings a year, involving about 16,000 reviewers from the scientific community. Dr. Nakamura has had a 32-year tenure at the National Institute of Mental Health (NIMH), where he has served as both Scientific Director and Deputy Director of the institute, and he served as Acting Director from 2001 to 2002. During his time at NIMH, he received a number of leadership awards, including the Presidential Rank Award for outstanding leadership. He came to NIMH in 1976 as a postdoctoral fellow. In the mid-80’s he coordinated NIMH’s Biobehavioral Program and later was Chief of its Integrative Neuroscience Research Branch. Between 1997 and 2007, he served as the institute’s Deputy Director. From 2007 to 2011 he has been institute Scientific Director. While at NIMH, he also has held other positions, including Associate Director for Science Policy and Program Planning; Chief, Behavioral and Integrative Neuroscience Research Branch; and Coordinator, ADAMHA Office of Animal Research Issues. Dr. Nakamura attended the Bronx High School of Science and earned his B.A. in psychology from Earlham College in Richmond, Indiana. He received his Ph.D. in psychology from the State University of New York in Stony Brook. Dr. Nakamura has expertise in a number of areas, including cognitive and comparative neuroscience, science policy/funding and ethics in science. He has published 30 peer reviewed scientific journal articles, most related to neurocognition in primates.

Franklin Sayre

Mr. Sayre serves as the liaison to the College of Pharmacy where his focus is on serving the education and research needs of students, researchers, and faculty. Franklin received his double B.A. in the History and Philosophy of Science and Psychology from York University in Toronto, and his Master of Library and Information Studies (MLIS) from the University of British Columbia. He comes to University of Minnesota from the University of British Columbia where he served as the liaison to the Faculty of Pharmaceutical Sciences and the School of Population and Public Health. Franklin’s main areas of interest are teaching evidence-based practice, understanding the data management practices of bench scientists, and supporting research commercialization.

Ida Sim

Dr. Sim is a primary care physician, informatics researcher, and entrepreneur. She is a Professor of Medicine at the University of California, San Francisco, where she co-directs Biomedical Informatics at UCSF's Clinical and Translational Sciences Institute. Her current research focuses on the use of mobile apps and sensors to improve health and manage disease for populations and individuals, and to make clinical research faster and less expensive. She is a co-founder of Open mHealth, a non-profit organization that is breaking down barriers to mobile health app and data integration through an open software architecture. Open mHealth is an official working group of the IEEE Standards Association and is on track to becoming a global IEEE standard. In 2005, Dr. Sim was the founding Project Coordinator of the World Health Organization's International Clinical Trials Registry Platform, where she led the establishment of the first global policy on clinical trial registration and defined the common 20-item Trial Registration Data Set that all registers worldwide adhere to. She served on the Institute of Medicine's committee on Strategies of Responsible Sharing of Clinical Trial Data and is a co-founder of Vivli, a non-profit organization that is building a global data sharing platform for participant-level clinical trial data. Dr. Sim has served on multiple advisory committees on health information infrastructure for clinical care and research, including committees of the National Research Council and Institute of Medicine. She is a recipient of the United States Presidential Early Career Award for Scientists and Engineers (PECASE), a Fellow of the American College of Medical Informatics, and a member of the American Society for Clinical Investigation.

Valda Vinson

Dr. Vinson started her career in publishing when she joined the Science staff in 1999. Since then, she has handled research papers in the areas of structural biology, biochemistry, and biophysics as an AssociateSenior Editor, and Deputy Editor. She has also edited Perspectives and served as a team leader. As Editor, Valda oversees research content in the areas of biological, life, and social sciences, working with these editors to attract and select exciting research papers and reviews, while maintaining high editorial standards. She earned an M.Sc. in Chemistry from Durban University in 1987 and a Ph.D. from Johns Hopkins University in 1992. Her postdoctoral studies were also undertaken at Johns Hopkins University, where she focused on structural and biochemical studies of cytoskeletal proteins. Before joining Science, she spent two years as a Senior Lecturer at the University of the Western Cape, South Africa.

Log In

Sign in to access your saved publications, downloads, and email preferences.

Former MyNAP users: You'll need to reset your password on your first login to MyAcademies. Click "Forgot password" below to receive a reset link via email. Having trouble? Visit our FAQ page to contact support.

Members of the National Academy of Sciences, National Academy of Engineering, or National Academy of Medicine should log in through their respective Academy portals.

Email (required)
Password (required)

Don't have an account?

Register

Email (required)
New password (required)
Retype password (required) Password must be at least 8 characters
I accept the terms of use
terms of use

Thank You

Thank you for creating a MyAcademies account!

Enjoy free access to thousands of National Academies' publications, a 10% discount off every purchase, and build your personal library.

Forgot Password

Enter the email address for your MyAcademies (formerly MyNAP) account to receive password reset instructions.

Reset Requested

We sent password reset instructions to your email . Follow the link in that email to create a new password. Didn't receive it? Check your spam folder or contact us for assistance.

Reset Password

New password (required)
Retype password (required) Password must be at least 8 characters

Reset Password

Your password has been reset.

Log In

Verify email

Verify Your Email Address

We sent a verification link to your email. Please check your inbox (and spam folder) and follow the link to verify your email address. If you did not receive the email, you can request a new verification link below

Subscribe

First Name
Last Name
Email (required)
I agree to receive emails from the National Academies (required)

We respect your privacy and will never share your information.

Enhancing Scientific Reproducibility through Transparent Reporting: A Workshop

Featured publication

Description

Collaborators

Committee

Sponsors

Staff

Parent projects

Forum on Drug Discovery, Development, and Translation

National Cancer Policy Forum

Roundtable on Genomics and Precision Health

Forum on Neuroscience and Nervous System Disorders

Major units and sub-units

Contact

Contact us

Provide feedback

Request materials

More like this

Forum on Drug Discovery, Development, and Translation

Forum on Neuroscience and Nervous System Disorders

Roundtable on Genomics and Precision Health

Life Sciences and Biotechnology Program Area

Review of Methods in the Report on Carcinogens Handbook

Center for Health, People, and Places

Response to the Centers for Medicare & Medicaid Services CY 2025 Advanced Primary Care Hybrid Payment Request for Information

Response to the “Pay PCPs [Primary Care Providers] Act of 2024” Request for Information

Clinical Trials of Far UV to Reduce Indoor Transmission of Respiratory Infections

Additional materials

Publication information

Suggested citation

My Academies

Enhancing Scientific Reproducibility through Transparent Reporting: A Workshop

Dropdown items

Featured publication

Enhancing Scientific Reproducibility in Biomedical Research Through Transparent Reporting: Proceedings of a Workshop

Description

Collaborators

Committee

Sponsors

Staff

Parent projects

Forum on Drug Discovery, Development, and Translation

National Cancer Policy Forum

Roundtable on Genomics and Precision Health

Forum on Neuroscience and Nervous System Disorders

Major units and sub-units

Contact

Contact us

Provide feedback

Request materials

More like this

Forum on Drug Discovery, Development, and Translation

Forum on Neuroscience and Nervous System Disorders

Roundtable on Genomics and Precision Health

Life Sciences and Biotechnology Program Area

Review of Methods in the Report on Carcinogens Handbook

Center for Health, People, and Places

Response to the Centers for Medicare & Medicaid Services CY 2025 Advanced Primary Care Hybrid Payment Request for Information

Response to the “Pay PCPs [Primary Care Providers] Act of 2024” Request for Information

Clinical Trials of Far UV to Reduce Indoor Transmission of Respiratory Infections