#researchquality — Public Fediverse posts

☕ August ReproducibiliTea Events!
Get ready for another great month of discussions! We have three amazing ReproducibiliTea journal clubs hosting sessions this August.

Check out the reading materials and join the conversation on open science and reproducibility:

Tokyo
Topic: "The last astronomers. Amid a flood of AI advances, astrophysicists are questioning the soul of their field"
Date & Time: Thursday, 6 August @ 10:45 AM (JST)
Reading: https://www.science.org/content/article/amid-flood-ai-advances-astrophysicists-are-questioning-soul-their-field
More Details: https://twitter.com/repTeaTokyo

Bielefeld
Topic: "The reproducibility of research and the misinterpretation of p-values"
Date & Time: Friday, 7 August @ 12:00 PM (CET)
Reading: https://doi.org/10.1098/rsos.171085
Info & Zoom Link: https://burst.pages.ub.uni-bielefeld.de/burst/

Melbourne
Topic: TBC (Stay tuned!)
Date & Time: Thursday, 27 August @ 4:00 PM (Melbourne time)
More Info: https://reproducibilitea.org/journal-clubs/#Melbourne
Join the Mailing List for Updates: http://shorturl.at/mELZ3

See you there!

#ReproducibiliTea #OpenScience #Reproducibility #JournalClub #ResearchQuality #AcademicChatter #DataScience

The growing crisis of “AI slop” that endangers scientific publishing.

#FakeScience #InformationOverload #AIEthics #ScientificIntegrity #ResearchQuality #PeerReview #AcademicPublishing #OpenScience #TrustInScience

https://www.theatlantic.com/science/2026/01/ai-slop-science-publishing/685704/

The growing crisis of “AI slop” that endangers scientific publishing. #FakeScience #InformationOverload #AIEthics #ScientificIntegrity #ResearchQuality #PeerReview #AcademicPublishing #OpenScience #TrustInScience www.theatlantic.com/science/2026...

Science Is Drowning in AI Slop

Received the annual invite to THE's Global Academic Reputation Survey. 📩 To me, this feels like a game of name recognition. For example, I was asked to rank 5 universities in my field, and I didn’t recognize a single one. 🤷 I chose not to respond, but I suspect many do. As a result, rankings often reflect stereotypes or general perceptions, not real knowledge of academic excellence.

#AcademicIntegrity #UniversityRankings #HigherEducation #ReputationMetrics #ResearchQuality #EducationMatters

Patent quality might be measured by being dissimilar to what came before... but similar to what came after.

Adam Jaffe speaking at ICSSI (icssi.org) highlights this suggestion of Kelly et al. (2021).
https://www.aeaweb.org/articles?id=10.1257/aeri.20190499

#ScienceOfScience #ICSSI #AdamJaffe #Patents #ResearchQuality

Peer review’s irremediable flaws: Scientists’ perspectives on grant evaluation in Germany

https://microblogging.infodocs.eu/2024/02/28/peer-reviews-irremediable-flaws-scientists-perspectives-on-grant-evaluation-in-germany/

#AxelPhilipps #EvaBarlsius #Germany #LauraParuschke #PeerReview #ResearchAssessment #ResearchQuality #ScientificCommunication

I fear that my typical grant reviews are easily spotted:

"With [removing work package X // stopping workstream A after achieving y], the whole project's chances of achieving multiple of its (other) [goals/ deliverables] would increase substantially."

#OverPromising #Funding #PeerReview
Edit #ResearchAssessment #ResearchQuality

Remember Bem's "Feeling the future", one of the events that kicked off the #replicationCrisis in #psychology in 2011?

Now @kekecsz et al published a replication report that showcases best practices (https://royalsocietypublishing.org/doi/10.1098/rsos.191375):
* Consensus protocol based on adversarial collaboration
* born open data
* Video-verified training
* real-time updating report
* external audit
* ...

Great work. It's amazing to compare the #researchQuality of 2011 with this cutting edge showcase. How far we have come!

@karolina @pwgtennant If meta-science involves careful critical appraisal and an assessment of methodological and reporting quality, then bad science doesn't prevent meta-science from proceeding. Naïve analyses will admittedly be GIGO. #MetaScience #BadScience #ResearchQuality #CriticalAppraisal

🧮 How can we measure #researchQuality in #psychology?

The #DORA declaration tells us what *not* to do. But what to do instead?

A working group (commissioned by the German Psychological Society & in the spirit of #CoARA) now proposed a way to practically measure research quality in hiring & promotion, w/o resorting to JIF or h-index.

1/

I started a company this year that makes training for researchers to promote #ResearchQuality.
Our first course is getting really good interest. It's so pleasing! If you know a university that could do with better #ResearchIntegrity training, could you let them know we exist?
https://trickygoose.training/
cheers!