#researchassessment — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #researchassessment, aggregated by home.social.
-
An interesting paper by Lutz Bornmann and António Osório on incentives, competition, and undesirable practices in science.
The debate over research metrics is often framed too simply: metrics or no metrics? A better question is: what kind of behaviour does an evaluation system make rational? Good research assessment should make doing good science the rational choice.
:doi: https://doi.org/10.1038/s44319-026-00900-7
#ResearchEvaluation #ResearchAssessment #Scientometrics #ResearchIntegrity
-
An interesting evolution from Mike Thelwall. A year ago, he was cautiously exploring whether LLMs could approximate expert research assessment. Today, he reports that ChatGPT-5 mini reached correlations of up to 0.905 with expert REF2021 quality assessments across some disciplines, using a dataset of more than 107,000 UK research articles.
:doi: https://doi.org/10.1515/jdis-2026-0058
#ResearchEvaluation #Scientometrics #ResearchAssessment #ChatGPT #LLM #AI #SciencePolicy
-
A timely new commentary in the Journal of Clinical Epidemiology raises an uncomfortable question:
Can anti-metric research assessment reforms backfire in weak academic systems?
:doi: https://doi.org/10.1016/j.jclinepi.2026.112430
Reducing metrics may work where institutions are strong. But in fragile systems, it may unintentionally increase the influence of favouritism, academic inbreeding, and opaque decision-making.
#ResearchAssessment #CoARA #DORA #Bibliometrics #MetaResearch #OpenScience #SciencePolicy
-
🆕 The Helmholtz Modular Curriculum Vitae Template provides a flexible framework for designing CVs for tenure, hiring, and promotion processes. It combines narrative and quantitative elements and supports the selection of relevant evaluation criteria.
-
Can a national research ranking claim to reward the "most productive researchers" while capping the value of additional scientific output?
I looked closely at the formula behind Ukraine's new government-funded ranking. My conclusion: it optimizes for something quite different. Full explanation on LinkedIn 👇
#ResearchEvaluation #ResearchAssessment #SciencePolicy #OpenScience #CoARA #DORA
-
The next #RESQUE consultation hour:
17th of June, 9-10am CEST
https://www.resque.info/news/2026-06-01-consultation%20hours.htmlThe Research Quality Evaluation (RESQUE) framework provides recommendations for responsible #ResearchAssessment for hiring and promotion in #psychology
www.resque.infoThe session will also highlight specific topics such as applying RESQUE in #ClinicalPsychology with the clinical expansion pack.
See also previous post for more links and info:
https://mastodon.social/deck/@jrboehnke/116652740649620274 -
📢 Published
German #CoARA National Chapter Workshop Report
on the connection between #ResearchAssessment reforms and #excellence in research👉 EN: https://doi.org/10.5281/zenodo.20348689
👉 DE: https://doi.org/10.5281/zenodo.20348630 -
You can read more about #RESQUE and community responses in this excellent issue of #MetaPsychology
https://conferences.lnu.se/index.php/metapsychology/issue/view/297Topic-specific expansion packs are developing, eg., a #PrePrint for #ClinicalPsychology and #PsychotherapyResearch
https://osf.io/preprints/psyarxiv/6gwr8_v1 -
Another opportunity to work w #RESQUE
The Research Quality Evaluation framework provides recommendations for responsible research assessment beyond typical metrics for hiring and promotion in #psychology:
www.resque.infoMaybe of interest for other areas as well?
-
A new study analysing 248 CoARA action plans suggests that many organizations still treat Open Science more as a set of values than as concrete research practices.
:doi: https://doi.org/10.1007/s11192-026-05650-w
Open Access remains the dominant and most institutionalized form of Open Science, appearing in 41% of plans. Meanwhile, key UNESCO-promoted practices such as Open Evaluation or Open Methods are barely mentioned at all.
-
📣 When others talk about your work, you know it's making an impact:
🔹 Science Europe cited OSMI's frameworks in their position statement on Open Science & Research Assessment Reform
🔹 The French Open Science Barometer recognised OSMI's role in uniting nearly 200 members worldwide
🔹 Make Data Count referenced OSMI's landscape mapping in their blogCurious to see who else is talking about us? 👉 https://open-science-monitoring.org/about/they-talk-about-osmi/
#OpenScience #OpenScienceMonitoring #OSMI #ResearchAssessment
-
Heute geht um: Wie machen wir unsichtbare Beiträge in der Wissenschaft sichtbar? Denn nur, wenn die Vielfalt der Tätigkeiten klar wird, können wir dazu übergehen, auch verschiedene Tätigkeiten in die Bewertung einfließen zu lasen. #researchassessment
-
Der neueste Helmholtz Open Science Newsletter ist erschienen!
➡️ Eine neue Ära für Open Research Europe: Deutschland beteiligt sich an der Europäischen Allianz für kostenfreies Open-Access-Publizieren.
➡️ Forschungsbewertung bei @helmholtz: Wir teilen spannende Erkenntnisse aus einer zentrenübergreifenden Umfrage.
➡️ @pid4nfdi: Aktuelle Entwicklungen aus dem NFDI-Basisdienst.
👉 Jetzt den vollständigen Newsletter lesen: https://lnkd.in/dVb2ZANW
-
Participaré en dos sesiones del Ciclo Iberoamericano de Webinars sobre Gestión de la I+i, desde Consortia:
29 abril: #OpenScience como enfoque transversal en la gestión de la investigación.
20 mayo: #ResponsibleMetrics
en sistemas de evaluación institucional.
Horario: 10:00–13:00 (GMT-5). Acceso abierto.
#OpenScience #ResearchAssessment #OpenAccess #ResearchManagement #CienciaAbierta
🔗https://docs.google.com/forms/d/e/1FAIpQLSd2fv9zVtW9tzFQRZbxeqR5vYiOTeICGb5XBaRR5OkpwGuLFA/viewform -
An unintended but positive side effect of the rise of AI and LLMs is that it may accelerate the long overdue reform of research assessment. If the "journals" are flooded with slop academia will be forced to take DORA seriously.
-
In the #RESQUE evaluation scheme („Research Quality Evaluation scheme for psychological research“), there is an indicator for publications: “Correctness of computational results has been independently verified“.
With CODECHECK, you can request and upload a verification certificate. This gives you "extra points“ in our evaluation scheme, as this is a real quality criterion.
#researchAssessment #CoARA @aufdroeseler https://nerdculture.de/@aufdroeseler/116165190898955396
-
"Zwischen Kritik und Aufbruch: Die Debatte um die #Forschungsbewertung" in der Open-Science-Snack-Reihe der @slubdresden:
https://osl.hypotheses.org/21296
#ResearchAssessment #OpenScience -
Introductory course on responsible research assessment, just published by #SFDORA
https://sfdora.org/courses/introductory-course-to-responsible-research-assessment/The free and self-paced course "aims to empower anyone to challenge existing assumptions around research quality and impact, by introducing them to the concept of responsible research assessment, its foundational principles, and how RRA aims to improve evaluation practices."
-
The Helmholtz Open Science Office has published its own #CoARA action plan.
The action plan offers:
🕶️ An overview of the interactions between open science and research assessment reform
👁️ Classification of the current status quo
🚀 Measures and planned activities for the period 2026–2030 -
Today is the 24th birthday of the Budapest Open Access Initiative.
https://www.budapestopenaccessinitiative.org/read/Best known for catalyzing the #OpenAccess movement in 2002, the BOAI has been continuously active and formed a nonprofit organization just last year.
https://www.budapestopenaccessinitiative.org/news/boai-transitioning-to-organization-to-support-the-development-of-equitable-open-access/See the org's progress report on its first year.
https://www.budapestopenaccessinitiative.org/news/boai-celebrates-anniversary-and-reflects-on-progress-of-first-year-as-an-organization/The latest version of the BOAI recommendations is its 20th anniversary statement.
https://www.budapestopenaccessinitiative.org/boai20/In contrast to the earlier BOAI statements, which made many recommendations, the 20th anniversary statement deliberately focuses on a small number of top priorities:
1. Adopting #OpenInfrastructure
2. Reforming #ResearchAssessment
3. Moving away from #APCs
4. Moving away from #ReadAndPublish agreements.I'm proud of my contributions to #BOAI (2002), #BOAI10 (2012), and #BOAI20 (2022), and honored to serve on the org steering committee.
Happy #ValentinesDay to all who work for #OpenAccess worldwide.