Reproducibility and Replicability in Science (2019)

Chapter: 6 Improving Reproducibility and Replicability

Previous Chapter: 5 Replicability
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 105.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 106.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 107.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 108.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 109.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 110.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 111.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 112.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 113.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 114.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 115.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 116.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 117.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 118.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 119.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 120.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 121.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 122.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 123.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 124.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 125.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 126.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 127.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 128.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 129.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 130.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 131.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 132.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 133.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 134.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 135.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 136.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 137.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 138.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 139.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 140.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 141.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.

There was a problem loading page 142.

Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 105
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 106
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 107
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 108
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 109
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 110
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 111
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 112
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 113
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 114
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 115
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 116
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 117
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 118
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 119
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 120
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 121
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 122
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 123
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 124
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 125
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 126
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 127
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 128
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 129
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 130
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 131
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 132
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 133
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 134
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 135
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 136
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 137
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 138
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 139
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 140
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 141
Suggested Citation: "6 Improving Reproducibility and Replicability." National Academies of Sciences, Engineering, and Medicine. 2019. Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. doi: 10.17226/25303.
Page 142
Next Chapter: 7 Confidence in Science
Subscribe to Email from the National Academies
Keep up with all of the activities, publications, and events by subscribing to free updates by email.