TWO psychology lecturers from the University of Winchester took part in a worldwide meta-scientific study that has been published in Science magazine.

Dr Manuela Thomae and Dr Michael Wood participated in an international collaboration with 270 leading scientists for the Reproducibility Project: Psychology – designed to assess the reproducibility of psychological research. To date, the project is the most comprehensive investigation everv undertaken about the rate and predictors of reproducibility.

The academics submitted their findings in a research paper called: Estimating the Reproducibility of Psychological Science that was collectively authored by the Open Science Collaboration. It was based on evidence collected from replications of 100 published psychology studies.

“Here at Winchester, we conducted a pre-registered replication of an experiment assessing whether people act in their own individual best interest or in the best interest of the group to which they belong,” said Dr Thomae. “Using male undergraduate students from Israel, the original scientists found that once you disentangle opposing motives, such as helping one’s own versus harming the others, the overriding motivation driving most people to engage in conflict is the desire to help their own – even if it comes at great personal expense.

“We successfully replicated this finding with an undergraduate participant sample from the University of Winchester. However, the overall picture painted by this large-scale replication effort is less optimistic.”

The Reproducibility Project: Psychology found that regardless of the analytic method or criteria used, fewer than half of the replications produced the same findings as the original study.

Mallory Kidwell, one of the project coordinators from the Centre for Open Science, concluded: “The results provide suggestive evidence toward the challenges of reproducing research findings, including identifying predictors of reproducibility and practices to improve it.”

Since the Reproducibility Project began in 2011, similar projects have emerged in other fields such as the Reproducibility Project: Cancer Biology, and the discipline of meta-science is expanding – scientific research about scientific research.

These and the widespread efforts to improve research transparency and reproducibility are indications that, as suggested by team member Susann Fiedler from the Max Planck Institute for Research on Collective Goods: “Science is actively self-examining and self-correcting to maximise the quality and efficiency of the research process in the service of building knowledge for the public good.”

Dr Thomae, added: “Science is unique from other ways of gaining knowledge by relying on reproducibility to gain confidence in ideas and evidence.

“Reproducibility means that the results recur when the same data are analysed again, or when new data are collected using the same methods.”