MetaROR

📝 Do preregistration and registered reports restrict exploratory research? This research plan aims to find out.

"A persistent concern about implementation of preregistration and Registered Reports in psychology is that doing so would reduce the frequency and value of exploratory research, and therefore restrict creativity, serendipity, and discovery," the authors write. Their project aims to "provide an empirical basis to be used in future discussion about the impact of registration on exploratory research."

The two MetaROR reviewers agree that the research question is important but think the proposal as-is doesn't support its claims yet. They also raise some methodological concerns and question design choices.

🙏 We want to thank our partner Lifecycle Journal for making this evaluation possible. Thanks also to the authors (@syeducation@bird.makeup, Caroline H. Armstrong, Emily J. Chan, Abby Person), reviewers (Alexandra Sarafoglou, Marcel van Assen) & editors (Kathryn Zeiler, Olmo van den Akker)

👇 Read the full research plan, editorial assessment & reviews now on the MetaROR website https://metaror.org/article/evaluating-the-claim-that-preregistration-and-registered-reports-restrict-exploratory-research

🔖 Now up on MetaROR: a full evaluation of the Handbook for Reproduction and Replication Studies, which enables researchers to conduct high-quality reproductions & replications across social science disciplines.

Reviewers praised it as timely & useful while providing recommendations.

This was a massive undertaking and we are very grateful to our reviewers (Hannah Fraser, Vittorio Iacovella, Wolf Vanpaemel),
editors (@stephenpinfield@mstdn.social, Kathryn Zeiler) and of course all authors ( @aufdroeseler@nerdculture.de, @lukaswallrich@sciences.social, @helenahartmann@fediscience.org, Luisa Altegoer, Veronica Boyce, @smirandafield@akademienl.social, Janik Goltermann, Joachim Hüffmeier, @drcpennington@mastodon.social, @mmpittelkow@fediscience.org, @priyasilverstein@sciences.social, Don van Ravenzwaaij & @flavioazevedo@mastodon.social)

Read the full evaluation including the handbook's full text now on the MetaROR website 👇 https://metaror.org/article/handbook-for-reproduction-and-replication-studies/

Today we publish the evaluation of a bibliometric analysis of (bilateral & multilateral) scientific collaboration intensity between Russia and other countries.

Reviewers recognize the approach's value & also provide (literature) suggestions.

👏 As always, we are grateful to the authors (Tim Engels, Ronald Rousseau,
@ZhouHy@mastodon.social), reviewers (Gunnar Sivertsen, Dmitry Kochetkov) and editor (@LudoWaltman@social.cwts.nl) for their contributions!

👇 Read the assessment, reviews and full text on MetaROR https://metaror.org/article/the-relative-intensity-of-bilateral-and-multilateral-co-authorship-with-russia-since-1995/

While we were secretly already here, we're happy to announce that MetaROR is now also active on Mastodon!

We're a community-owned platform for open peer review in metaresearch, led jointly by @RoRInstitute@indieweb.social and @aimos@masto.ai. Using the innovative Publish-Review-Curate model, we're transforming how metaresearch is published & reviewed, making the process faster and more open.

Find us on metaror.org

🎓 Today we publish another evaluation for an article whose authors present a novel method—developed through a series of workshops—for assessing academics.

🙏 Thanks, as always, to the authors, reviewers & editors!

👇 Read the full text, reviews & editorial assessment on MetaROR https://metaror.org/kotahi/articles/43/index.html

"What could alternative academic publishing practices that safeguard the integrity of research look like?" This article in The Conversation has some ideas.

👇Great piece and thank you for the shout-out 🫶

https://theconversation.com/academic-publishing-is-a-multibillion-dollar-industry-its-not-always-good-for-science-250056

🖇️In our latest submission we look at a review paper whose "authors examine reproducibility and replicability in qualitative research, including hundreds of published papers and the grey literature". According to the editorial assessment, "both reviewers found the article to be technically sound, interesting, and of likely value to the field."

👏 We thank the authors (Nicki Lisa Cole, Sven Ulpts, Agata Bochynska, Eva Kormann, Matthew Good, Barbara Leitner and @tonyRH@mstdn.social), reviewers ( @adam42smith@fediscience.org) and editors (Adrian Barnett, Kathryn Zeiler) for their efforts and trust.

👇 Read the assessment, reviews and full text on MetaROR
https://metaror.org/kotahi/articles/35/index.html

🆔 What is the role of persistent identifiers and metadata standards in open science governance? Today we publish the assessment, reviews and full text of a paper asking that question.

👏 We thank the authors ( @IsabelAbedrap, Ricardo Hartley Belmar & Pablo Sánchez-Núñez) for trusting MetaROR, and the reviewers (@martateperek@akademienl.social , @mfenner@hachyderm.io) and our editor (@LudoWaltman@social.cwts.nl) for their contributions

👇 As always, everything is publicly available on MetaROR https://metaror.org/kotahi/articles/100/index.html

🤝 Transformative agreements have become an important strategy in the transition to open access yet they suffer from important transparency limitations. Today, MetaROR publishes the editorial assessment and reviews for a paper analyzing them using open metadata.

👇 Read it now on MetaROR
https://metaror.org/kotahi/articles/55/index.html

This article proposes restructuring scientific papers, with front-loaded narratives for humans as well as machine-readable appendices.

The two reviewers found the idea worthwhile and timely, while also suggesting more engagement with previous work and it needing an update on the AI processing.

The author of this article is @Zhicheng Lin, reviewers are David Resnik, Iratxe Puebla, @soilandreyes@scholar.social and one anonymous reviewer, and editors are @alexh@fediscience.org and Kathryn Zeiler. Thanks to all for your efforts! 👏

👇 Read the full evaluation (including the editorial assessment, reviews, and the full article text, on the MetaROR website) https://metaror.org/article/restructuring-scientific-papers-for-human-and-ai-readers