home.social

#researchassessment — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #researchassessment, aggregated by home.social.

  1. Der neueste Helmholtz Open Science Newsletter ist erschienen!

    ➡️ Eine neue Ära für Open Research Europe: Deutschland beteiligt sich an der Europäischen Allianz für kostenfreies Open-Access-Publizieren.

    ➡️ Forschungsbewertung bei @helmholtz: Wir teilen spannende Erkenntnisse aus einer zentrenübergreifenden Umfrage.

    ➡️ @pid4nfdi: Aktuelle Entwicklungen aus dem NFDI-Basisdienst.

    👉 Jetzt den vollständigen Newsletter lesen: lnkd.in/dVb2ZANW

    #OpenScience #OpenAccess #ResearchAssessment #PID

  2. Participaré en dos sesiones del Ciclo Iberoamericano de Webinars sobre Gestión de la I+i, desde Consortia:

    29 abril: #OpenScience como enfoque transversal en la gestión de la investigación.

    20 mayo: #ResponsibleMetrics

    en sistemas de evaluación institucional.
    Horario: 10:00–13:00 (GMT-5). Acceso abierto.
    #OpenScience #ResearchAssessment #OpenAccess #ResearchManagement #CienciaAbierta
    🔗docs.google.com/forms/d/e/1FAI

  3. An unintended but positive side effect of the rise of AI and LLMs is that it may accelerate the long overdue reform of research assessment. If the "journals" are flooded with slop academia will be forced to take DORA seriously.

    #ResearchAssessment #COARA

  4. In the #RESQUE evaluation scheme („Research Quality Evaluation scheme for psychological research“), there is an indicator for publications: “Correctness of computational results has been independently verified“.

    resque.info

    With CODECHECK, you can request and upload a verification certificate. This gives you "extra points“ in our evaluation scheme, as this is a real quality criterion.

    codecheck.org.uk

    #researchAssessment #CoARA @aufdroeseler nerdculture.de/@aufdroeseler/1

  5. Introductory course on responsible research assessment, just published by #SFDORA
    sfdora.org/courses/introductor

    The free and self-paced course "aims to empower anyone to challenge existing assumptions around research quality and impact, by introducing them to the concept of responsible research assessment, its foundational principles, and how RRA aims to improve evaluation practices."

    #REF2029 #ResearchAssessment

  6. The Helmholtz Open Science Office has published its own #CoARA action plan.

    The action plan offers:
    🕶️ An overview of the interactions between open science and research assessment reform
    👁️ Classification of the current status quo
    🚀 Measures and planned activities for the period 2026–2030

    👉 doi.org/10.5281/zenodo.18242817

    #OpenScience #ResearchAssessment @CoARAssessment

  7. Today is the 24th birthday of the Budapest Open Access Initiative.
    budapestopenaccessinitiative.o

    Best known for catalyzing the #OpenAccess movement in 2002, the BOAI has been continuously active and formed a nonprofit organization just last year.
    budapestopenaccessinitiative.o

    See the org's progress report on its first year.
    budapestopenaccessinitiative.o

    The latest version of the BOAI recommendations is its 20th anniversary statement.
    budapestopenaccessinitiative.o

    In contrast to the earlier BOAI statements, which made many recommendations, the 20th anniversary statement deliberately focuses on a small number of top priorities:

    1. Adopting #OpenInfrastructure
    2. Reforming #ResearchAssessment
    3. Moving away from #APCs
    4. Moving away from #ReadAndPublish agreements.

    I'm proud of my contributions to #BOAI (2002), #BOAI10 (2012), and #BOAI20 (2022), and honored to serve on the org steering committee.

    Happy #ValentinesDay to all who work for #OpenAccess worldwide.

  8. Uni-Präsident Prof. Oliver Günther wurde als der einzige deutsche Vertreter in das Steering Board der Coalition for Advancing Research Assessment (CoARA) gewählt.

    CoARA ist eine internationale Initiative, die sich für eine faire, transparente und qualitative Weiterentwicklung der Bewertung wissenschaftlicher Forschung einsetzt.

    Zur Medienmitteilung: uni-potsdam.de/de/nachrichten/

    #CoARA #researchassessment #collaboration #international #research #forschung

  9. Conflating "Responsible Metrics" with "Responsible Assessment" is a common strategic error in research management.

    Responsible Metrics focus on data sources and quantification (the technical side). Responsible Assessment focuses on institutional processes, ethics, and people (the political/governance side).

    Adopting better data tools (like OpenAlex) without reforming decision-making cultures is not a solution. It is often just a way to make the same mistakes using better data.

    My latest analysis on why this distinction is critical for policy design: copdeb.com/2025/12/22/diferenc

    #ResearchAssessment #OpenScience #CoARA #Bibliometrics #SciPol #ResearchManagement

  10. Bogota Manifesto:
    Towards an Open, Democratic and Socially Relevant Science in Latin America and the Caribbean
    sfdora.org/2025/12/19/bogota-m

    Three strategic pillars 👇

    One of 11 guiding principles:

    Critical #pedagogy: Foster training and collective reflection on #OpenScience and responsible assessment as transformative practices

    #SFDORA #ResearchAssessment #REF2029

  11. New research in Journal of Informetrics asked 2,300+ social scientists from 42 countries: what are your top-3 publications?

    :doi: doi.org/10.1016/j.joi.2025.101

    Only ~40% of self-identified “top” works also ranked in the author’s top-3 by citations. Even tripling citation counts wouldn’t push nearly a third of them into the bibliometric top. And 17% of “best” works don’t even appear in Scopus - especially in sociology and political science.

    #Metrics #Bibliometrics #ResearchAssessment #Citations

  12. Although, or perhaps precisely because, the participants at the Research Assessment conference tend to be experienced and committed individuals, it is a very interesting conference. Many challenges are addressed, and at the same time it is motivating to see how small steps can change thinking and behaviour with regard to cultural change in science.

    #cerra2025 #researchAssessment #openscience #CoARA #DORA #CoARACopenhagen @DORAssessment @CoARAssessment

  13. Participation in the breakout session "Leadership in change" at the CeRRA conference. Interesting perspectives and examples of the implementation of research assessment in institutions and the role that leadership play in this process.
    The audience was also involved, and the mood was captured with red and green cards.

    What would you choose? Choose one card

    #cerra2025 #researchAssessment #openscience #CoARA #DORA #CoARACopenhagen @DORAssessment @CoARAssessment

  14. Happy Birthday to CoARA
    Celebrating three years of Coalition for Advancing Research Assessment in Denmark at Aalborg University in Copenhagen

    #cerra2025 #researchAssessment #openscience #CoARA #DORA #CoARACopenhagen @DORAssessment @CoARAssessment

  15. In preparation of the EU High-Level Presidency Conference on Reforming Research Assessment (CeRRA), held in Copenhagen on Dec 3-4, 2025, the present report presents findings from ten case studies of international research funding agencies including public agencies, private foundations, independent research charities, and mission-driven institutions.

    cerra.aau.dk/new-report-from-a

    #cerra2025 #researchAssessment #openscience #CoARA #DORA @DORAssessment @CoARAssessment

  16. For ten years, #CRediT 🎂 has offered 14 standardized contributor roles that make authorship transparent: nature.com/articles/d41586-025

    But there is a clear gap: CRediT has no place for #AI tools. So how should we properly disclose the use of ChatGPT & Co in research? One answer is #GAIDeT - Generative AI Delegation Taxonomy w3id.org/gaidet

    #ResearchIntegrity #Responsible #OpenScience #Infrastructure #AIinResearch #Metadata #ResearchAssessment #AIinScience #AIethics

  17. Udice, l'association de 13 universités intensives en recherche, s’engage avec @CoARAssessment pour une nouvelle culture de l’évaluation de la recherche.

    udice.org/2025/11/04/udice-sen

    "Depuis plusieurs années, Udice œuvre pour une recherche d’excellence, ouverte et intègre. Ce positionnement s’inscrit aujourd’hui dans un mouvement global de réflexion sur les modes d’évaluation de la recherche, qui influencent directement les orientations scientifiques, les carrières, et la dynamique de l’innovation."

    #Udice
    #ResearchAssessment
    #evaluationdelarecherche
    #scienceouverte

  18. Looking forward to the conference - and to discuss the importance and implications of open research information for the STI community! #scientometrics #bibliometrics #researchassessment

  19. 📣 Starting today: Science Maps. Bibliometrics between understanding and visualization

    Together with Marcus John, I organize a small series on science mapping for our workgroup "WG Visualization" at Competence Network Bibliometrics. We hop to gether traditional, current, and critical perspectives on one of the most established and iconic forms of visualizing data in #Bibliometrics and #NetworkAnalysis.

    More talks will be announced soon!

    Today, Katy Börner will kickoff our series with a presentation about "Mapping and Modeling Science, Technology, and Education". You can find further info and registration under the following link:

    linkedin.com/pulse/kb-open-res

    #vosviewer #Scientometrics #Gephi #DataVisualization #DataViz #Informetrics #STI2025 #Bibliometrie #ResearchAssessment

  20. "Reviews are also produced free of charge, and editors often work without pay. This is how journals and publishers make a profit based on the prestige of their journals and the pressure to publish. This must change. But instead of resolutely tackling such systematic errors, we still talk too much about individual misconduct." (Anna Abalkina, in F&L interview, translated with DeepL)

    #diamondopenaccess #publishingreform #researchassessment #sfDORA #CoARA

  21. Damian Pattinson of @eLife (and my former boss at PLOS ONE) at The Royal Society's Future of Scientific Publishing conference describes the devastating effect on their submissions of Clarivate removing their Impact Factor due to their change in peer review model, then asks why other journals, including Science, don't renounce their own IFs.

    #SciComm #JournalPublishing #ImpactFactor #Clarivate #WebOfScience #PeerReview #TheRoyalSociety #FutureOfScientificPublishing #Citations #Bibliometrics #ResearchImpact #ResearchAssessment

  22. One thing we are working on in the ATRIUM project is the assessment of non-traditional research outputs in the Humanities. I have written a blogpost to explain why, what and how: dariahopen.hypotheses.org/2113 #openmethods #ATRIUMproject #overlayjournals #openaccess #researchassessment cc @dariaheu

  23. One thing we are working on in the ATRIUM project is the assessment of non-traditional research outputs in the Humanities. I have written a blogpost to explain why, what and how: dariahopen.hypotheses.org/2113 #openmethods #ATRIUMproject #overlayjournals #openaccess #researchassessment cc @dariaheu

  24. One thing we are working on in the ATRIUM project is the assessment of non-traditional research outputs in the Humanities. I have written a blogpost to explain why, what and how: dariahopen.hypotheses.org/2113 #openmethods #ATRIUMproject #overlayjournals #openaccess #researchassessment cc @dariaheu

  25. One thing we are working on in the ATRIUM project is the assessment of non-traditional research outputs in the Humanities. I have written a blogpost to explain why, what and how: dariahopen.hypotheses.org/2113 #openmethods #ATRIUMproject #overlayjournals #openaccess #researchassessment cc @dariaheu

  26. One thing we are working on in the ATRIUM project is the assessment of non-traditional research outputs in the Humanities. I have written a blogpost to explain why, what and how: dariahopen.hypotheses.org/2113 #openmethods #ATRIUMproject #overlayjournals #openaccess #researchassessment cc @dariaheu

  27. How do countries assess research? With spreadsheets, committees, metrics - and increasingly, soul-searching. A new @RoRInstitute study compares 13 national systems and maps a quiet shift: from 'publish or perish' to 'be useful, be fair':

    👉 doi.org/10.6084/m9.figshare.29

    No silver bullets, just a very thoughtful typology.

    #ResearchAssessment #OpenScience #CoARA #ResearchPolicy #Evaluation

  28. Being a "Highly Cited Researcher" has gone from a sign of having impact as a researcher to a potential indicator of misconduct.

    "Manipulations have been so obvious and large that, in 2024, over 2,000 researchers were removed from a HCR list containing some 6,600 names." - Lauranne Chaignon

    blogs.lse.ac.uk/impactofsocial

    #ResearchImpact #HighlyCitedResearchers #Bibliometrics #Scientometrics #ResearchAssessment #Citations #CitationManipulation #CitationScience #ScientificMisconduct #ImpactOfSocialSciences

  29. #PredatoryJournal is a complex issue. I consider that we should focus on two things: 1. Support researchers before they submit a Paper, 2. Reform #ResearchAssessment

    I'm against generalizations in this subject.

  30. MDPI as a corruption indicator? A new preprint shows a striking trend across Europe 🇪🇺: more MDPI papers → higher perceived corruption → lower innovation.

    👉 arxiv.org/abs/2411.06282v1

    It’s not that MDPI = bad. But when it dominates, it signals a broken system chasing quantity over quality.

    Ukraine? 🇺🇦 Not in the study, but we see the same rise of #MDPI. We could build better. Instead, we copy the worst.

    #AcademicPublishing #SciencePolicy #ResearchAssessment #Bibliometrics #CorruptionIndex

  31. News from the @DORAssessment page:

    Brief report about a project aimed to test the effectiveness of multimedia formats for educating researchers about scholarly metrics
    sfdora.org/2025/04/07/introduc

    The team used multiple strategies to develop content and format of the videos. I found it an interesting brief read for the planning of educational resources.

    If you have not heard about problems with the #hIndex: Another reason to watch. #AcademicChatter

    #ResearchAssessment #REF2029 #VideoTaxonomy

  32. 🇧🇷 vs 🇳🇱 in #ResearchEvaluation? A sharp comparative study shows how Brazil’s high-stakes, performance-based model contrasts with the Netherlands’ strategic, decentralized approach.

    :doi: doi.org/10.1093/reseval/rvaf01

    Takeaway: Evaluation isn’t one-size-fits-all - context matters.

    #ResearchAssessment #SciencePolicy #HigherEducation #ResponsibleMetrics #AcademicEvaluation

  33. ResearchFish Again

    One of the things I definitely don’t miss about working in the UK university system is the dreaded Researchfish. If you’ve never heard of this bit of software, it’s intended to collect data relating to the outputs of research grants funded by the various Research Councils. That’s not an unreasonable thing to want to do, of course, but the interface is – or at least was when I last used it several years ago – extremely clunky and user-unfriendly. That meant that, once a year, along with other academics with research grants (in my case from STFC) I had to waste hours uploading bibliometric and other data by hand. A sensible system would have harvested this automatically as it is mostly available online at various locations or allowed users simply to upload their own publication list as a file; most of us keep an up-to-date list of publications for various reasons (including vanity!) anyway. Institutions also keep track of all this stuff independently. All this duplication seemed utterly pointless.

    I always wondered what happened to the information I uploaded every year, which seemed to disappear without trace into the bowels of RCUK. I assume it was used for something, but mere researchers were never told to what purpose. I guess it was used to assess the performance of researchers in some way.

    When I left the UK in 2018 to work full-time in Ireland, I took great pleasure in ignoring the multiple emails demanding that I do yet another Researchfish upload. The automated reminders turned into individual emails threatening that I would never again be eligible for funding if I didn’t do it, to which I eventually replied that I wouldn’t be applying for UK research grants anymore anyway. So there. Eventually the emails stopped.

    Then, about three years ago, ResearchFish went from being merely pointless to downright sinister as a scandal erupted about the company that operates it (called Infotech), involving the abuse of data and the bullying of academics. I wrote about this here. It then transpired that UKRI, the umbrella organization governing the UK’s research council had been actively conniving with Infotech to target critics. An inquiry was promised but I don’t know what became of that.

    Anyway, all that was a while ago and I neither longer live nor work in the UK so why mention ResearchFish again, now?

    The reason is something that shocked me when I found out about it a few days ago. Researchfish is now operated by commercial publishing house Elsevier.

    Words fail. I can’t be the only person to see a gigantic conflict of interest. How can a government agency allow the assessment of its research outputs to be outsourced to a company that profits hugely by the publication of those outputs? There’s a phrase in British English which I think is in fairly common usage: marking your own homework. This relates to individuals or organizations who have been given the responsibility for regulating their own products. Is very apt here.

    The acquisition of Researchfish isn’t the only example of Elsevier getting its talons stuck into academia life. Elsevier also “runs” the bibliometric service Scopus which it markets as a sort of quality indicator for academic articles. I put “runs” in inverted commas because Scopus is hopelessly inaccurate and unreliable. I can certainly speak from experience on that. Nevertheless, Elsevier has managed to dupe research managers – clearly not the brightest people in the world – into thinking that Scopus is a quality product. I suppose the more you pay for something the less inclined you are to doubt its worth, because if you do find you have paid worthless junk you look like an idiot.

    A few days ago I posted a piece that include this excerpt from an article in Wired:

    Every industry has certain problems universally acknowledged as broken: insurance in health care, licensing in music, standardized testing in education, tipping in the restaurant business. In academia, it’s publishing. Academic publishing is dominated by for-profit giants like Elsevier and Springer. Calling their practice a form of thuggery isn’t so much an insult as an economic observation. 

    With the steady encroachment of the likes of Elsevier into research assessment, it is clear that as well as raking in huge profits, the thugs are now also assuming the role of the police. The academic publishing industry is a monstrous juggernaut that is doing untold damage to research and is set to do more. It has to stop.

    #bibliometrics #Elsevier #Infotech #ResearchAssessment #Researchfish #SCOPUS #UKRI

  34. An entertaining, informative and overall really well done video about the h-index and why you shouldn't use it, by @stefhaustein, @carey_mlchen et al.

    I really will be sharing this video a lot: "What is the h-index and what are its limitations? Or: Stop using the h-index"

    youtube.com/watch?v=HSf79S3XkJw

    #hIndex #bibliometrics #researchEvaluation #researchAssessment #publishOrPerish

    @academicchatter

  35. 📢 Today's Open Science Day at @GFZ

    🔓 Including a talk by @mathijsvleugel on "Rethinking Research Assessment: Moving Beyond Traditional Metrics to Foster Quality and Impact" featuring insights on @DORAssessment and @CoARAssessment

    💬 Including further talks as well as hands-on workshop sessions on #OpenAccess #FAIR #ResearchAssessment

    🔗 events.hifis.net/event/2175/ti

    #OpenScience #ResearchAssessment #OpenScienceDay (lmf)

  36. Today is the 23d birthday of the Budapest Open Access Initiative.
    budapestopenaccessinitiative.o

    BOAI is still active and issued its 20th anniversary recommendations in 2022.
    budapestopenaccessinitiative.o

    Unlike previous BOAI statements, which made many recommendations, the 20th anniversary statement deliberately focused on just a small number of top priorities:

    1. Adopting #OpenInfrastructure
    2. Reforming #ResearchAssessment
    3. Moving away from #APCs
    4. Moving away from #ReadAndPublish agreements.

    I'm proud of my association with the #BOAI, #BOAI10, and #BOAI20.

    Happy #ValentinesDay to all who are working for #OpenAccess worldwide.

  37. Opening keynote for PUBMET 2024 is @MsPhelps. Can we broaden & widen research assessment?

    DORA promotes widening RA from journal articles & narrow metrics. All activities, not only outcomes, should be assessed. Look at research lines, design, process, & knowledge dissemination, & judge how they meet strategic goals. Allows collective decisions & safeguards good practice.

    tinyurl.com/pubmet-2024-kramer

    🧵

    #ResearchAssessment #PUBMET2024 #OpenScience #OpenInformation #OpenInfrastructure #OpenResearch

  38. Opening keynote for PUBMET 2024 is @MsPhelps. Can we broaden & widen research assessment?

    DORA promotes widening RA from journal articles & narrow metrics. All activities, not only outcomes, should be assessed. Look at research lines, design, process, & knowledge dissemination, & judge how they meet strategic goals. Allows collective decisions & safeguards good practice.

    tinyurl.com/pubmet-2024-kramer

    🧵

    #ResearchAssessment #PUBMET2024 #OpenScience #OpenInformation #OpenInfrastructure #OpenResearch

  39. Opening keynote for PUBMET 2024 is @MsPhelps. Can we broaden & widen research assessment?

    DORA promotes widening RA from journal articles & narrow metrics. All activities, not only outcomes, should be assessed. Look at research lines, design, process, & knowledge dissemination, & judge how they meet strategic goals. Allows collective decisions & safeguards good practice.

    tinyurl.com/pubmet-2024-kramer

    🧵

    #ResearchAssessment #PUBMET2024 #OpenScience #OpenInformation #OpenInfrastructure #OpenResearch

  40. Opening keynote for PUBMET 2024 is @MsPhelps. Can we broaden & widen research assessment?

    DORA promotes widening RA from journal articles & narrow metrics. All activities, not only outcomes, should be assessed. Look at research lines, design, process, & knowledge dissemination, & judge how they meet strategic goals. Allows collective decisions & safeguards good practice.

    tinyurl.com/pubmet-2024-kramer

    🧵

    #ResearchAssessment #PUBMET2024 #OpenScience #OpenInformation #OpenInfrastructure #OpenResearch

  41. Opening keynote for PUBMET 2024 is @MsPhelps. Can we broaden & widen research assessment?

    DORA promotes widening RA from journal articles & narrow metrics. All activities, not only outcomes, should be assessed. Look at research lines, design, process, & knowledge dissemination, & judge how they meet strategic goals. Allows collective decisions & safeguards good practice.

    tinyurl.com/pubmet-2024-kramer

    🧵

    #ResearchAssessment #PUBMET2024 #OpenScience #OpenInformation #OpenInfrastructure #OpenResearch

  42. #Keynote2 #oat24 Klare Worte von Victoria Tsoukala: Diamond OA wird sich nicht durchsetzen, wenn sich Logik der Forschungsbewertung nicht ändert – daher unterstützt die EC #CoARA 💎 🧐 📈
    #enabling #researchassessment

  43. @evanwolf

    This from the article you posted is troubling for meta-reasons I'll explain after the quote:

    «models don’t take into consideration … melting Greenland ice. Massive amounts of fresh water are sloughing off the ice sheet and flowing into the North Atlantic, which disrupts one of the circulation’s driving forces: salt.

    “You’re already getting a huge influx of fresh water into the northern Atlantic, which is going to completely disrupt the system,” Rahmstorf said.

    This research gap means the predictions could underestimate how soon or fast a collapse would happen, Rahmstof said.»

    This feels typical of what I see in climate research when assessing risk or severity. People keep thinking that a conservative estimate is one that doesn't get the researcher in trouble, but some such estimates DO get the public in trouble by not stating the true risk.

    We need a better understanding that a conservative estimate is not about what you can prove, but what you can't disprove. I'm really tired of being surprised by underestimates of severity because some researcher didn't want to overstate things.

    We are in a war, and we do not normally prepare for wars by only guarding against attacks we can prove will happen. We need to prepare for things that are plausible and cannot be disproven. Even now, after being surprised by new information almost continuously for decades, we still haven't gotten out of this rut of conservative prediction.

    It's going to kill us as certainly as the actual problem is because it robs us of the one thing we do (or ought) have control over, which is discussion of the situation in its proper form, with a frank assessment of the true risk.

    #climate #risk #AMOC #ClimateCommunication #Research #ResearchAssessment #ethics #ClimateCrisis

  44. Michael Upshall critiques the commentary “Open excess: remove open access burden from REF”: consultmu.co.uk/is-open-access

    This jumped out at me:
    "The Oxford team claim it costs their university £20M to check 15,000 articles and other outputs [for OA status] – a cost of £1,333 to process each article."

    If that's true, I never again want to hear research managers complain about high publishing costs. Journals are massively efficient by comparison!

    #REF2029 #ResearchAssessment #OpenAccess

  45. Integrating Indonesian research institutions into The National Research and Innovation Agency of Indonesia (BRIN) was linked to an increase in the growth of research publications and the number of reputable journals they appeared in.

    New bibliometric study published in the EASE journal, European Science Editing, by Setiowiji Handoyo, Poppy Indah Dwi Prastiti, & Iwan Ridwan Stiaji: doi.org/10.3897/ese.2024.e1180

    #Bibliometrics #Indonesia #EuropeanScienceEditing #ResearchAssessment #JournalPublication