Harmonization of Approaches to Nutrient Reference Values: Applications to Young Children and Women of Reproductive Age (2018)

Chapter: Appendix D: Tools and Methods to Evaluate the Risk of Bias in Individual Studies

Previous Chapter: Appendix C: AGREE II Instrument
Suggested Citation: "Appendix D: Tools and Methods to Evaluate the Risk of Bias in Individual Studies." National Academies of Sciences, Engineering, and Medicine. 2018. Harmonization of Approaches to Nutrient Reference Values: Applications to Young Children and Women of Reproductive Age. Washington, DC: The National Academies Press. doi: 10.17226/25148.

Appendix D

Tools and Methods to Evaluate the Risk of Bias in Individual Studies

Below are examples of tools and methods that were developed to measure the strength of various studies as well as the risk of bias in randomized trials, nonrandomized studies, diagnostic test accuracy, cohort studies, randomized controlled trials, and case control studies. The table below has been adapted from the European Food Safety Authority’s 2017 report The Principles and Methods Behind EFSA’s Guidance on Uncertainty Analysis in Scientific Assessment.

ToolStudy Design or Applicable SettingInstitutionReference
Office of Health Assessment and Translation Risk of Bias (RoB) ToolExperimental animal studies, human randomized controlled trial (RCT), human observationalNational Toxicology Programme (NTP)https://ntp.niehs.nih.gov/ntp/ohat/pubs/riskofbiastool_508.pdf (accessed August 6, 2018)
RoB 2.0Risk of bias in randomized trialsCochrane collaborationhttps://sites.google.com/site/riskofbiastool/welcome/rob-2-0-tool (accessed August 6, 2018)
Suggested Citation: "Appendix D: Tools and Methods to Evaluate the Risk of Bias in Individual Studies." National Academies of Sciences, Engineering, and Medicine. 2018. Harmonization of Approaches to Nutrient Reference Values: Applications to Young Children and Women of Reproductive Age. Washington, DC: The National Academies Press. doi: 10.17226/25148.
ToolStudy Design or Applicable SettingInstitutionReference
Robins-IRisk of bias in nonrandomized studies of interventionsCochrane collaborationhttps://sites.google.com/site/riskofbiastool/welcome/home (accessed August 6, 2018)
RoB Diagnostic Test AccuracyRisk of bias in diagnostic test accuracyCochrane Canadahttp://training.cochrane.org/resource/primer-cochrane-diagnostic-test-accuracy-reviews (accessed August 6, 2018)
Tool to assess risk of bias in cohort studiesRisk of bias in cohort studiesCLARITY Grouphttps://www.evidencepartners.com/resources/methodological-resources (accessed August 6, 2018)
Tool to assess risk of bias in randomized controlled trialsRisk of bias in RCTCLARITY Grouphttps://www.evidencepartners.com/resources/methodological-resources (accessed August 6, 2018)
Tool to assess risk of bias in case control studiesRisk of bias in case control studiesCLARITY Grouphttps://www.evidencepartners.com/resources/methodological-resources (accessed August 6, 2018)

SOURCE: Adapted with permission from EFSA et al., 2018.

REFERENCE

EFSA Scientific Committee, D. Benford, T. Halldorsson, M. J. Jeger, H. K. Knutsen, S. More, H. Naegeli, H. Noteborn, C. Ockleford, A. Ricci, G. Rychen, J. R. Schlatter, V. Silano, R. Solecki, D. Turck, M. Younes, P. Craig, A. Hart, N. Von Goetz, K. Koutsoumanis, A. Mortensen, B. Ossendorp, A. Germini, L. Martino, C. Merten, O. Mosbach-Schulz, A. Smith, and A. Hardy. 2018. Scientific opinion on the principles and methods behind EFSA’s Guidance on Uncertainty Analysis in Scientific Assessment. EFSA Journal 16(1):5122-5235.

Suggested Citation: "Appendix D: Tools and Methods to Evaluate the Risk of Bias in Individual Studies." National Academies of Sciences, Engineering, and Medicine. 2018. Harmonization of Approaches to Nutrient Reference Values: Applications to Young Children and Women of Reproductive Age. Washington, DC: The National Academies Press. doi: 10.17226/25148.
Page 141
Suggested Citation: "Appendix D: Tools and Methods to Evaluate the Risk of Bias in Individual Studies." National Academies of Sciences, Engineering, and Medicine. 2018. Harmonization of Approaches to Nutrient Reference Values: Applications to Young Children and Women of Reproductive Age. Washington, DC: The National Academies Press. doi: 10.17226/25148.
Page 142
Next Chapter: Appendix E: Scaling Methods to Extrapolate from Reference Values of One Age Group to Another
Subscribe to Emails from the National Academies
Stay up to date on activities, publications, and events by subscribing to email updates.