#coara — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #coara, aggregated by home.social.
-
Can a national research ranking claim to reward the "most productive researchers" while capping the value of additional scientific output?
I looked closely at the formula behind Ukraine's new government-funded ranking. My conclusion: it optimizes for something quite different. Full explanation on LinkedIn 👇
#ResearchEvaluation #ResearchAssessment #SciencePolicy #OpenScience #CoARA #DORA
-
Can a national research ranking claim to reward the "most productive researchers" while capping the value of additional scientific output?
I looked closely at the formula behind Ukraine's new government-funded ranking. My conclusion: it optimizes for something quite different. Full explanation on LinkedIn 👇
#ResearchEvaluation #ResearchAssessment #SciencePolicy #OpenScience #CoARA #DORA
-
Can a national research ranking claim to reward the "most productive researchers" while capping the value of additional scientific output?
I looked closely at the formula behind Ukraine's new government-funded ranking. My conclusion: it optimizes for something quite different. Full explanation on LinkedIn 👇
#ResearchEvaluation #ResearchAssessment #SciencePolicy #OpenScience #CoARA #DORA
-
Can a national research ranking claim to reward the "most productive researchers" while capping the value of additional scientific output?
I looked closely at the formula behind Ukraine's new government-funded ranking. My conclusion: it optimizes for something quite different. Full explanation on LinkedIn 👇
#ResearchEvaluation #ResearchAssessment #SciencePolicy #OpenScience #CoARA #DORA
-
Can a national research ranking claim to reward the "most productive researchers" while capping the value of additional scientific output?
I looked closely at the formula behind Ukraine's new government-funded ranking. My conclusion: it optimizes for something quite different. Full explanation on LinkedIn 👇
#ResearchEvaluation #ResearchAssessment #SciencePolicy #OpenScience #CoARA #DORA
-
The next #RESQUE consultation hour:
17th of June, 9-10am CEST
https://www.resque.info/news/2026-06-01-consultation%20hours.htmlThe Research Quality Evaluation (RESQUE) framework provides recommendations for responsible #ResearchAssessment for hiring and promotion in #psychology
www.resque.infoThe session will also highlight specific topics such as applying RESQUE in #ClinicalPsychology with the clinical expansion pack.
See also previous post for more links and info:
https://mastodon.social/deck/@jrboehnke/116652740649620274 -
The next #RESQUE consultation hour:
17th of June, 9-10am CEST
https://www.resque.info/news/2026-06-01-consultation%20hours.htmlThe Research Quality Evaluation (RESQUE) framework provides recommendations for responsible #ResearchAssessment for hiring and promotion in #psychology
www.resque.infoThe session will also highlight specific topics such as applying RESQUE in #ClinicalPsychology with the clinical expansion pack.
See also previous post for more links and info:
https://mastodon.social/deck/@jrboehnke/116652740649620274 -
The next #RESQUE consultation hour:
17th of June, 9-10am CEST
https://www.resque.info/news/2026-06-01-consultation%20hours.htmlThe Research Quality Evaluation (RESQUE) framework provides recommendations for responsible #ResearchAssessment for hiring and promotion in #psychology
www.resque.infoThe session will also highlight specific topics such as applying RESQUE in #ClinicalPsychology with the clinical expansion pack.
See also previous post for more links and info:
https://mastodon.social/deck/@jrboehnke/116652740649620274 -
The next #RESQUE consultation hour:
17th of June, 9-10am CEST
https://www.resque.info/news/2026-06-01-consultation%20hours.htmlThe Research Quality Evaluation (RESQUE) framework provides recommendations for responsible #ResearchAssessment for hiring and promotion in #psychology
www.resque.infoThe session will also highlight specific topics such as applying RESQUE in #ClinicalPsychology with the clinical expansion pack.
See also previous post for more links and info:
https://mastodon.social/deck/@jrboehnke/116652740649620274 -
The next #RESQUE consultation hour:
17th of June, 9-10am CEST
https://www.resque.info/news/2026-06-01-consultation%20hours.htmlThe Research Quality Evaluation (RESQUE) framework provides recommendations for responsible #ResearchAssessment for hiring and promotion in #psychology
www.resque.infoThe session will also highlight specific topics such as applying RESQUE in #ClinicalPsychology with the clinical expansion pack.
See also previous post for more links and info:
https://mastodon.social/deck/@jrboehnke/116652740649620274 -
📢 Published
German #CoARA National Chapter Workshop Report
on the connection between #ResearchAssessment reforms and #excellence in research👉 EN: https://doi.org/10.5281/zenodo.20348689
👉 DE: https://doi.org/10.5281/zenodo.20348630 -
📢 Published
German #CoARA National Chapter Workshop Report
on the connection between #ResearchAssessment reforms and #excellence in research👉 EN: https://doi.org/10.5281/zenodo.20348689
👉 DE: https://doi.org/10.5281/zenodo.20348630 -
📢 Published
German #CoARA National Chapter Workshop Report
on the connection between #ResearchAssessment reforms and #excellence in research👉 EN: https://doi.org/10.5281/zenodo.20348689
👉 DE: https://doi.org/10.5281/zenodo.20348630 -
📢 Published
German #CoARA National Chapter Workshop Report
on the connection between #ResearchAssessment reforms and #excellence in research👉 EN: https://doi.org/10.5281/zenodo.20348689
👉 DE: https://doi.org/10.5281/zenodo.20348630 -
📢 Published
German #CoARA National Chapter Workshop Report
on the connection between #ResearchAssessment reforms and #excellence in research👉 EN: https://doi.org/10.5281/zenodo.20348689
👉 DE: https://doi.org/10.5281/zenodo.20348630 -
Another opportunity to work w #RESQUE
The Research Quality Evaluation framework provides recommendations for responsible research assessment beyond typical metrics for hiring and promotion in #psychology:
www.resque.infoMaybe of interest for other areas as well?
-
Another opportunity to work w #RESQUE
The Research Quality Evaluation framework provides recommendations for responsible research assessment beyond typical metrics for hiring and promotion in #psychology:
www.resque.infoMaybe of interest for other areas as well?
-
Another opportunity to work w #RESQUE
The Research Quality Evaluation framework provides recommendations for responsible research assessment beyond typical metrics for hiring and promotion in #psychology:
www.resque.infoMaybe of interest for other areas as well?
-
Another opportunity to work w #RESQUE
The Research Quality Evaluation framework provides recommendations for responsible research assessment beyond typical metrics for hiring and promotion in #psychology:
www.resque.infoMaybe of interest for other areas as well?
-
Another opportunity to work w #RESQUE
The Research Quality Evaluation framework provides recommendations for responsible research assessment beyond typical metrics for hiring and promotion in #psychology:
www.resque.infoMaybe of interest for other areas as well?
-
A new study analysing 248 CoARA action plans suggests that many organizations still treat Open Science more as a set of values than as concrete research practices.
:doi: https://doi.org/10.1007/s11192-026-05650-w
Open Access remains the dominant and most institutionalized form of Open Science, appearing in 41% of plans. Meanwhile, key UNESCO-promoted practices such as Open Evaluation or Open Methods are barely mentioned at all.
-
A new study analysing 248 CoARA action plans suggests that many organizations still treat Open Science more as a set of values than as concrete research practices.
:doi: https://doi.org/10.1007/s11192-026-05650-w
Open Access remains the dominant and most institutionalized form of Open Science, appearing in 41% of plans. Meanwhile, key UNESCO-promoted practices such as Open Evaluation or Open Methods are barely mentioned at all.
-
A new study analysing 248 CoARA action plans suggests that many organizations still treat Open Science more as a set of values than as concrete research practices.
:doi: https://doi.org/10.1007/s11192-026-05650-w
Open Access remains the dominant and most institutionalized form of Open Science, appearing in 41% of plans. Meanwhile, key UNESCO-promoted practices such as Open Evaluation or Open Methods are barely mentioned at all.
-
A new study analysing 248 CoARA action plans suggests that many organizations still treat Open Science more as a set of values than as concrete research practices.
:doi: https://doi.org/10.1007/s11192-026-05650-w
Open Access remains the dominant and most institutionalized form of Open Science, appearing in 41% of plans. Meanwhile, key UNESCO-promoted practices such as Open Evaluation or Open Methods are barely mentioned at all.
-
A new study analysing 248 CoARA action plans suggests that many organizations still treat Open Science more as a set of values than as concrete research practices.
:doi: https://doi.org/10.1007/s11192-026-05650-w
Open Access remains the dominant and most institutionalized form of Open Science, appearing in 41% of plans. Meanwhile, key UNESCO-promoted practices such as Open Evaluation or Open Methods are barely mentioned at all.
-
Are we measuring Open Science the right way? 🔍
Indicators shape incentives, researcher behaviour, and funding decisions – so getting them right matters.
Join OSMI Co-chair Iratxe Puebla & other experts at a free EOSC Track webinar:
📅 29 May 2026 | 11:00–12:30 CEST
🔗 https://eu01web.zoom.us/webinar/register/WN_wMKgM2QwR-SC622nths_gg#/registration
Especially relevant for research policy makers, funders, #CoARA & #EOSC communities.
#OpenScience #OSMI #ResponsibleMetrics #ResearchReform -
Are we measuring Open Science the right way? 🔍
Indicators shape incentives, researcher behaviour, and funding decisions – so getting them right matters.
Join OSMI Co-chair Iratxe Puebla & other experts at a free EOSC Track webinar:
📅 29 May 2026 | 11:00–12:30 CEST
🔗 https://eu01web.zoom.us/webinar/register/WN_wMKgM2QwR-SC622nths_gg#/registration
Especially relevant for research policy makers, funders, #CoARA & #EOSC communities.
#OpenScience #OSMI #ResponsibleMetrics #ResearchReform -
#CoARA, #DORA etc. want to (rightfully) broaden the evaluative criteria for academic performance - to not just reward the quantity of publications (which led to paper mills and fake publications that you can buy).
See Goodhart's law in action: Now academics can also buy patents:
"Patents, like peer reviewed publications, look impressive in CVs, and many institutions reward them. [...] A research team with lead at Northwestern University in the United States reports a new type of academic fraud: fake patents. They have found multiple companies which sell credits on UK registered designs to academics, mostly in India, who can use them to boost promotion scores and institutional rankings."
:oa: https://zenodo.org/records/14889136
Found on Sabine Hossenfelder’s blog: https://sabine.beehiiv.com/p/patent-fraud-a-record-battery-satellite-pollution-and-energy-from-the-vacuum
-
#CoARA, #DORA etc. want to (rightfully) broaden the evaluative criteria for academic performance - to not just reward the quantity of publications (which led to paper mills and fake publications that you can buy).
See Goodhart's law in action: Now academics can also buy patents:
"Patents, like peer reviewed publications, look impressive in CVs, and many institutions reward them. [...] A research team with lead at Northwestern University in the United States reports a new type of academic fraud: fake patents. They have found multiple companies which sell credits on UK registered designs to academics, mostly in India, who can use them to boost promotion scores and institutional rankings."
:oa: https://zenodo.org/records/14889136
Found on Sabine Hossenfelder’s blog: https://sabine.beehiiv.com/p/patent-fraud-a-record-battery-satellite-pollution-and-energy-from-the-vacuum
-
Tout à fait ! ... sauf que #DORA / #CoARA reste mal connu des collègues élus ou nommés dans des instances de recrutement, évaluation ou promotion.
Il faut aussi leur proposer des méthodes pour pouvoir faire le travail demandé (qui finit quand même par mettre une relation d'ordre sur un groupe de projets/gens brillants qui font des choses très différentes...) en respectant ces principes.
Ça existe, mais c'est du boulot.
-
Tout à fait ! ... sauf que #DORA / #CoARA reste mal connu des collègues élus ou nommés dans des instances de recrutement, évaluation ou promotion.
Il faut aussi leur proposer des méthodes pour pouvoir faire le travail demandé (qui finit quand même par mettre une relation d'ordre sur un groupe de projets/gens brillants qui font des choses très différentes...) en respectant ces principes.
Ça existe, mais c'est du boulot.
-
Das #Bundesverfassungsgericht hat die #Zweitveröffentlichungspflicht im Hochschulgesetz BW für nichtig erklärt.
Was bedeutet das für die Steuerung der #OpenAccess Transformation in der Zukunft?
🔍 Ich habe dazu ein paar Gedanken beim @verfassungsblog notiert.
💡 Zentrale These:
Verpflichtende rechtliche Steuerungsmodelle stoßen schnell an kompetenz-, grund- & unionsrechtliche Grenzen.
Ein wirksamer Hebel ist dagegen die Reform der #Forschungsbewertung #CoARA -
Das #Bundesverfassungsgericht hat die #Zweitveröffentlichungspflicht im Hochschulgesetz BW für nichtig erklärt.
Was bedeutet das für die Steuerung der #OpenAccess Transformation in der Zukunft?
🔍 Ich habe dazu ein paar Gedanken beim @verfassungsblog notiert.
💡 Zentrale These:
Verpflichtende rechtliche Steuerungsmodelle stoßen schnell an kompetenz-, grund- & unionsrechtliche Grenzen.
Ein wirksamer Hebel ist dagegen die Reform der #Forschungsbewertung #CoARA -
As is the case for nearly all complex systems, changing a process is going to be not only difficult, take a long time but also meet a "chicken & egg" problem (causality dilemma). The goal of science is to create and disseminate knowledge. At least for publicly funded research projects, the deliverables should be publicly available. In the past decade, much progress has been made to reach #openscience, including moving from a closed journals to an "open-access" model (whether it actually reduced the financial burden on organizations is another matter entirely).
In the case of the open science reform, the "chicken & egg" problem asks whether researchers should practice open science first, or should the research ecosystem adopt open science first?
1) With strict resource constraints (time, funding, workforce), researchers don't have time to dedicate to deliverables that don't provide a direct value. The values of open science are laudable, but they are not rewarded. Why would researchers spend time creating and sharing a FAIR dataset when publishing another paper with that time is preferable for career advancement?
2) If the research ecosystem adopts open science (one way or another), e.g., researchers MUST publish code, data, register protocols, etc., then there is a huge non-adoption risk, or even worse a malicious compliance risk. A highly valued right for researchers is their academic freedom. In some ways, project-based funding is already threatening academic freedom, then what would it look like if grant agencies started withholding further funding because they didn't publish X or Y dataset?In an era and a society where work is often meaningless or people are not convinced by their company's values and purposes, research is probably one of the remaining job where the work is driven by the person themselves. For that reason, the culture is very strong and/or opinionated because people actually like their jobs.
Hidden in the problem above is the interdependency between culture, trust and research reforms. Jonny Coates points many issues in a thoughtful piece [1], including that researchers MUST be at the center of the system reform: "Many reform initiatives are designed for researchers, but not often with them. If open science, assessment reform, and research culture initiatives are to succeed, active researchers need to be more than subjects. They need to be participants in designing the systems they are expected to use.".
-
An unintended but positive side effect of the rise of AI and LLMs is that it may accelerate the long overdue reform of research assessment. If the "journals" are flooded with slop academia will be forced to take DORA seriously.
-
An unintended but positive side effect of the rise of AI and LLMs is that it may accelerate the long overdue reform of research assessment. If the "journals" are flooded with slop academia will be forced to take DORA seriously.
-
An unintended but positive side effect of the rise of AI and LLMs is that it may accelerate the long overdue reform of research assessment. If the "journals" are flooded with slop academia will be forced to take DORA seriously.
-
An unintended but positive side effect of the rise of AI and LLMs is that it may accelerate the long overdue reform of research assessment. If the "journals" are flooded with slop academia will be forced to take DORA seriously.
-
An unintended but positive side effect of the rise of AI and LLMs is that it may accelerate the long overdue reform of research assessment. If the "journals" are flooded with slop academia will be forced to take DORA seriously.
-
RE: https://mastodon.social/@OpenAIRE/116283445949332979
Excited to share this @OpenAIRE interview with @mathijsvleugel, head of our office & Chair of the #CoARA National Chapter Germany, reflecting on research assessment & sharing insights into our survey "Valuing what matters?" (further information & data set: https://doi.org/10.5281/zenodo.18944700) #ResponsibleResearchAssessment (lmf)
-
RE: https://mastodon.social/@OpenAIRE/116283445949332979
Excited to share this @OpenAIRE interview with @mathijsvleugel, head of our office & Chair of the #CoARA National Chapter Germany, reflecting on research assessment & sharing insights into our survey "Valuing what matters?" (further information & data set: https://doi.org/10.5281/zenodo.18944700) #ResponsibleResearchAssessment (lmf)
-
RE: https://wisskomm.social/@WissRat/116211637900668257
Zwei Beobachtungen aus der Pressekonferenz:
1) Quantitative Rankings sieht die Jury beim internationalen Wettbewerb kritisch. So fiel die Anmerkung, dass qualitative Begutachtungsverfahren gestärkt werden sollen und die Forschungsbewertung generell eine willkommene Veränderung durchlaufe (Stichwort #CoARA).
2) Die @BerlinUAlliance erhielt insbesondere Lob für ihren kooperativen Ansatz (Forschung, Lehre, Studium, Infrastruktur). Und die Ausweitung auf @b_r_50 wurde explizit begrüßt.
-
RE: https://wisskomm.social/@WissRat/116211637900668257
Zwei Beobachtungen aus der Pressekonferenz:
1) Quantitative Rankings sieht die Jury beim internationalen Wettbewerb kritisch. So fiel die Anmerkung, dass qualitative Begutachtungsverfahren gestärkt werden sollen und die Forschungsbewertung generell eine willkommene Veränderung durchlaufe (Stichwort #CoARA).
2) Die @BerlinUAlliance erhielt insbesondere Lob für ihren kooperativen Ansatz (Forschung, Lehre, Studium, Infrastruktur). Und die Ausweitung auf @b_r_50 wurde explizit begrüßt.
-
Quantitative Metriken setzen falsche Anreize. Was in vielen Disziplinen längst ein strukturelles Problem ist, hat die #Rechtswissenschaft noch nicht erfasst. Sie kann #Bewertungslogiken sowie #Publikationsinfrastruktur noch so gestalten, dass diese den epistemischen Anforderungen der Disziplin entsprechen & eine belastbare Grundlage für #Forschungsbewertung schaffen.
Wie? Dazu habe ich mit @philippfalkenburg bei #IntRechtDok ein #Preprint veröffentlicht:
https://doi.org/10.17176/20260309-114602-0
#CoARA #DOA #OA -
Quantitative Metriken verzerren #Forschungsbewertung & setzen falsche Anreize, das ist in vielen Disziplinen längst ein strukturelles Problem. Die #Rechtswissenschaft ist hiervon bislang weitgehend verschont & kann #Bewertungslogiken sowie #Publikationsinfrastruktur noch aktiv gestalten – wissenschaftsadäquat, ohne Kennzahlen als Qualitätsersatz.
Wie? Dazu habe ich mit @philippfalkenburg bei #IntRechtDok ein #Preprint veröffentlicht:
https://doi.org/10.17176/20260309-114602-0
#CoARA #Repuationsmonopole #DOA #OA -
In the #RESQUE evaluation scheme („Research Quality Evaluation scheme for psychological research“), there is an indicator for publications: “Correctness of computational results has been independently verified“.
With CODECHECK, you can request and upload a verification certificate. This gives you "extra points“ in our evaluation scheme, as this is a real quality criterion.
#researchAssessment #CoARA @aufdroeseler https://nerdculture.de/@aufdroeseler/116165190898955396
-
In the #RESQUE evaluation scheme („Research Quality Evaluation scheme for psychological research“), there is an indicator for publications: “Correctness of computational results has been independently verified“.
With CODECHECK, you can request and upload a verification certificate. This gives you "extra points“ in our evaluation scheme, as this is a real quality criterion.
#researchAssessment #CoARA @aufdroeseler https://nerdculture.de/@aufdroeseler/116165190898955396
-
📣 Der neueste Helmholtz Open Science Newsletter ist da!
Wir berichten u.a. über:✅ Das Helmholtz Open Science Office hat seinen eigenen #CoARA Aktionsplan zur Reform der Wissenschaftsbewertung veröffentlicht.
🇪🇺 Neue Impulse und forschungspolitische Entwicklungen aus Brüssel.
🔙 Rückblick: Highlights vom Forum Helmholtz Research Data Commons und Online-Seminar „Open Research Information in Action“.👉 Jetzt lesen: https://os.helmholtz.de/ueber-uns/newsletter/113
-
📣 Der neueste Helmholtz Open Science Newsletter ist da!
Wir berichten u.a. über:✅ Das Helmholtz Open Science Office hat seinen eigenen #CoARA Aktionsplan zur Reform der Wissenschaftsbewertung veröffentlicht.
🇪🇺 Neue Impulse und forschungspolitische Entwicklungen aus Brüssel.
🔙 Rückblick: Highlights vom Forum Helmholtz Research Data Commons und Online-Seminar „Open Research Information in Action“.👉 Jetzt lesen: https://os.helmholtz.de/ueber-uns/newsletter/113
-
The Helmholtz Open Science Office has published its own #CoARA action plan.
The action plan offers:
🕶️ An overview of the interactions between open science and research assessment reform
👁️ Classification of the current status quo
🚀 Measures and planned activities for the period 2026–2030