The goal of science is to accumulate knowledge that answers questions such as “How do things work?” and “Why do they work that way?” Scientists use a variety of methodologies to describe, predict, and explain natural phenomena. These methods are so diverse that it is difficult to define a unique scientific method, although all scientific methodologies share the assumption of repeatability (Hempel & Oppenheim, 1948; Kuhn, 1962; Popper, 1934; Salmon, 1989). In this chapter, we first briefly review why replications are highly valued but rarely published. Then we describe a collaborative effort — the Reproducibility Project — to estimate the rate and predictors of reproducibility in psychological science. Finally, we detail how we are conducting this project as a large-scale, distributed, open collaboration. A description of the procedures and challenges may assist and inspire other teams to conduct similar projects in other areas of science.

The Reproducibility Project: A model of large-scale collaboration for empirical research on reproducibility.

GALLIANI, ELISA MARIA;VIANELLO, MICHELANGELO;
2014

Abstract

The goal of science is to accumulate knowledge that answers questions such as “How do things work?” and “Why do they work that way?” Scientists use a variety of methodologies to describe, predict, and explain natural phenomena. These methods are so diverse that it is difficult to define a unique scientific method, although all scientific methodologies share the assumption of repeatability (Hempel & Oppenheim, 1948; Kuhn, 1962; Popper, 1934; Salmon, 1989). In this chapter, we first briefly review why replications are highly valued but rarely published. Then we describe a collaborative effort — the Reproducibility Project — to estimate the rate and predictors of reproducibility in psychological science. Finally, we detail how we are conducting this project as a large-scale, distributed, open collaboration. A description of the procedures and challenges may assist and inspire other teams to conduct similar projects in other areas of science.
2014
Implementing Reproducible Computational Research (A Volume in The R Series).
9781466561595
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11577/2641052
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 5
  • ???jsp.display-item.citation.isi??? ND
social impact