#researchassessment — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #researchassessment, aggregated by home.social.
-
RE: https://mastodon.social/@OpenAIRE/117206714160529167
Excited to be part of the #ARION consortium! Together with a fantastic group of project partners, the @HelmholtzOpenScienceOffice will be working on turning responsible research assessment into everyday practice 🚀 #OpenScience #ResearchAssessment #CoARA #DORA @OpenAIRE (lmf)
-
What is „Research Excellence“? We tried to fill an often empty term (some might call it a bullshit term) with some substance.
https://zenodo.org/records/21670038
(see also the booklet in the downloads for some explaining text).
This work was done together with Katarzyna Nawrot, Rachel Heyard and Davide Crepaldi in the CoARA Working Group „Responsible Metrics and Indicators“.
-
Das CoARA German National Chapter lädt ein:
➡️ #CoARA und verantwortungsvolle #Forschungsbewertung: Impulse für ein zukunftsorientiertes Verständnis von Exzellenz
👥 Miriam Kip, Matthias Kiesselbach, @mathijsvleugel
📅 07. Oktober 2026, 13:00 bis 14:00 Uhr
🌐 Online, auf Deutsch
ℹ️ Programm und Anmeldung: https://os.helmholtz.de/veranstaltungen/online-seminare/coara-und-verantwortungsvolle-forschungsbewertung-impulse-fuer-ein-zukunftsorientiertes-verstaendnis-von-exzellenz/
#ResearchAssessment #CoARA #Forschungsbewertung (lmf) -
Is Scopus really a curated bibliographic database?
A new Scientometrics study finds 2.7M records without author information, 500K+ records with unknown source titles, inconsistent document types, and even London recorded as an affiliation.
:doi: https://doi.org/10.1007/s11192-026-05778-9
A useful reminder: better research assessment starts with understanding and checking the data - not just pressing a button.
#Scopus #Bibliometrics #ResearchAssessment #Scientometrics #ResearchEvaluation
-
An interesting paper by Lutz Bornmann and António Osório on incentives, competition, and undesirable practices in science.
The debate over research metrics is often framed too simply: metrics or no metrics? A better question is: what kind of behaviour does an evaluation system make rational? Good research assessment should make doing good science the rational choice.
:doi: https://doi.org/10.1038/s44319-026-00900-7
#ResearchEvaluation #ResearchAssessment #Scientometrics #ResearchIntegrity
-
An interesting evolution from Mike Thelwall. A year ago, he was cautiously exploring whether LLMs could approximate expert research assessment. Today, he reports that ChatGPT-5 mini reached correlations of up to 0.905 with expert REF2021 quality assessments across some disciplines, using a dataset of more than 107,000 UK research articles.
:doi: https://doi.org/10.1515/jdis-2026-0058
#ResearchEvaluation #Scientometrics #ResearchAssessment #ChatGPT #LLM #AI #SciencePolicy
-
A timely new commentary in the Journal of Clinical Epidemiology raises an uncomfortable question:
Can anti-metric research assessment reforms backfire in weak academic systems?
:doi: https://doi.org/10.1016/j.jclinepi.2026.112430
Reducing metrics may work where institutions are strong. But in fragile systems, it may unintentionally increase the influence of favouritism, academic inbreeding, and opaque decision-making.
#ResearchAssessment #CoARA #DORA #Bibliometrics #MetaResearch #OpenScience #SciencePolicy
-
🆕 The Helmholtz Modular Curriculum Vitae Template provides a flexible framework for designing CVs for tenure, hiring, and promotion processes. It combines narrative and quantitative elements and supports the selection of relevant evaluation criteria.
-
Can a national research ranking claim to reward the "most productive researchers" while capping the value of additional scientific output?
I looked closely at the formula behind Ukraine's new government-funded ranking. My conclusion: it optimizes for something quite different. Full explanation on LinkedIn 👇
#ResearchEvaluation #ResearchAssessment #SciencePolicy #OpenScience #CoARA #DORA
-
The next #RESQUE consultation hour:
17th of June, 9-10am CEST
https://www.resque.info/news/2026-06-01-consultation%20hours.htmlThe Research Quality Evaluation (RESQUE) framework provides recommendations for responsible #ResearchAssessment for hiring and promotion in #psychology
www.resque.infoThe session will also highlight specific topics such as applying RESQUE in #ClinicalPsychology with the clinical expansion pack.
See also previous post for more links and info:
https://mastodon.social/deck/@jrboehnke/116652740649620274 -
📢 Published
German #CoARA National Chapter Workshop Report
on the connection between #ResearchAssessment reforms and #excellence in research👉 EN: https://doi.org/10.5281/zenodo.20348689
👉 DE: https://doi.org/10.5281/zenodo.20348630 -
You can read more about #RESQUE and community responses in this excellent issue of #MetaPsychology
https://conferences.lnu.se/index.php/metapsychology/issue/view/297Topic-specific expansion packs are developing, eg., a #PrePrint for #ClinicalPsychology and #PsychotherapyResearch
https://osf.io/preprints/psyarxiv/6gwr8_v1 -
Another opportunity to work w #RESQUE
The Research Quality Evaluation framework provides recommendations for responsible research assessment beyond typical metrics for hiring and promotion in #psychology:
www.resque.infoMaybe of interest for other areas as well?
-
A new study analysing 248 CoARA action plans suggests that many organizations still treat Open Science more as a set of values than as concrete research practices.
:doi: https://doi.org/10.1007/s11192-026-05650-w
Open Access remains the dominant and most institutionalized form of Open Science, appearing in 41% of plans. Meanwhile, key UNESCO-promoted practices such as Open Evaluation or Open Methods are barely mentioned at all.
-
📣 When others talk about your work, you know it's making an impact:
🔹 Science Europe cited OSMI's frameworks in their position statement on Open Science & Research Assessment Reform
🔹 The French Open Science Barometer recognised OSMI's role in uniting nearly 200 members worldwide
🔹 Make Data Count referenced OSMI's landscape mapping in their blogCurious to see who else is talking about us? 👉 https://open-science-monitoring.org/about/they-talk-about-osmi/
#OpenScience #OpenScienceMonitoring #OSMI #ResearchAssessment
-
Heute geht um: Wie machen wir unsichtbare Beiträge in der Wissenschaft sichtbar? Denn nur, wenn die Vielfalt der Tätigkeiten klar wird, können wir dazu übergehen, auch verschiedene Tätigkeiten in die Bewertung einfließen zu lasen. #researchassessment
-
Der neueste Helmholtz Open Science Newsletter ist erschienen!
➡️ Eine neue Ära für Open Research Europe: Deutschland beteiligt sich an der Europäischen Allianz für kostenfreies Open-Access-Publizieren.
➡️ Forschungsbewertung bei @helmholtz: Wir teilen spannende Erkenntnisse aus einer zentrenübergreifenden Umfrage.
➡️ @pid4nfdi: Aktuelle Entwicklungen aus dem NFDI-Basisdienst.
👉 Jetzt den vollständigen Newsletter lesen: https://lnkd.in/dVb2ZANW
-
Participaré en dos sesiones del Ciclo Iberoamericano de Webinars sobre Gestión de la I+i, desde Consortia:
29 abril: #OpenScience como enfoque transversal en la gestión de la investigación.
20 mayo: #ResponsibleMetrics
en sistemas de evaluación institucional.
Horario: 10:00–13:00 (GMT-5). Acceso abierto.
#OpenScience #ResearchAssessment #OpenAccess #ResearchManagement #CienciaAbierta
🔗https://docs.google.com/forms/d/e/1FAIpQLSd2fv9zVtW9tzFQRZbxeqR5vYiOTeICGb5XBaRR5OkpwGuLFA/viewform -
An unintended but positive side effect of the rise of AI and LLMs is that it may accelerate the long overdue reform of research assessment. If the "journals" are flooded with slop academia will be forced to take DORA seriously.
-
In the #RESQUE evaluation scheme („Research Quality Evaluation scheme for psychological research“), there is an indicator for publications: “Correctness of computational results has been independently verified“.
With CODECHECK, you can request and upload a verification certificate. This gives you "extra points“ in our evaluation scheme, as this is a real quality criterion.
#researchAssessment #CoARA @aufdroeseler https://nerdculture.de/@aufdroeseler/116165190898955396
-
"Zwischen Kritik und Aufbruch: Die Debatte um die #Forschungsbewertung" in der Open-Science-Snack-Reihe der @slubdresden:
https://osl.hypotheses.org/21296
#ResearchAssessment #OpenScience -
Introductory course on responsible research assessment, just published by #SFDORA
https://sfdora.org/courses/introductory-course-to-responsible-research-assessment/The free and self-paced course "aims to empower anyone to challenge existing assumptions around research quality and impact, by introducing them to the concept of responsible research assessment, its foundational principles, and how RRA aims to improve evaluation practices."