home.social

#researchquality — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #researchquality, aggregated by home.social.

  1. Received the annual invite to THE's Global Academic Reputation Survey. 📩 To me, this feels like a game of name recognition. For example, I was asked to rank 5 universities in my field, and I didn’t recognize a single one. 🤷 I chose not to respond, but I suspect many do. As a result, rankings often reflect stereotypes or general perceptions, not real knowledge of academic excellence.

    #AcademicIntegrity #UniversityRankings #HigherEducation #ReputationMetrics #ResearchQuality #EducationMatters

  2. Patent quality might be measured by being dissimilar to what came before... but similar to what came after.

    Adam Jaffe speaking at ICSSI (icssi.org) highlights this suggestion of Kelly et al. (2021).
    aeaweb.org/articles?id=10.1257

    #ScienceOfScience #ICSSI #AdamJaffe #Patents #ResearchQuality

  3. I fear that my typical grant reviews are easily spotted:

    "With [removing work package X // stopping workstream A after achieving y], the whole project's chances of achieving multiple of its (other) [goals/ deliverables] would increase substantially."

    #OverPromising #Funding #PeerReview
    Edit #ResearchAssessment #ResearchQuality

  4. Remember Bem's "Feeling the future", one of the events that kicked off the #replicationCrisis in #psychology in 2011?

    Now @kekecsz et al published a replication report that showcases best practices (royalsocietypublishing.org/doi):
    * Consensus protocol based on adversarial collaboration
    * born open data
    * Video-verified training
    * real-time updating report
    * external audit
    * ...

    Great work. It's amazing to compare the #researchQuality of 2011 with this cutting edge showcase. How far we have come!

  5. @karolina @pwgtennant If meta-science involves careful critical appraisal and an assessment of methodological and reporting quality, then bad science doesn't prevent meta-science from proceeding. Naïve analyses will admittedly be GIGO. #MetaScience #BadScience #ResearchQuality #CriticalAppraisal

  6. @karolina @pwgtennant If meta-science involves careful critical appraisal and an assessment of methodological and reporting quality, then bad science doesn't prevent meta-science from proceeding. Naïve analyses will admittedly be GIGO. #MetaScience #BadScience #ResearchQuality #CriticalAppraisal

  7. @karolina @pwgtennant If meta-science involves careful critical appraisal and an assessment of methodological and reporting quality, then bad science doesn't prevent meta-science from proceeding. Naïve analyses will admittedly be GIGO. #MetaScience #BadScience #ResearchQuality #CriticalAppraisal

  8. @karolina @pwgtennant If meta-science involves careful critical appraisal and an assessment of methodological and reporting quality, then bad science doesn't prevent meta-science from proceeding. Naïve analyses will admittedly be GIGO. #MetaScience #BadScience #ResearchQuality #CriticalAppraisal

  9. @karolina @pwgtennant If meta-science involves careful critical appraisal and an assessment of methodological and reporting quality, then bad science doesn't prevent meta-science from proceeding. Naïve analyses will admittedly be GIGO. #MetaScience #BadScience #ResearchQuality #CriticalAppraisal

  10. 🧮 How can we measure #researchQuality in #psychology?

    The #DORA declaration tells us what *not* to do. But what to do instead?

    A working group (commissioned by the German Psychological Society & in the spirit of #CoARA) now proposed a way to practically measure research quality in hiring & promotion, w/o resorting to JIF or h-index.

    1/

  11. CW: Reproducible research

    Reflecting on ~3 years of #InfectiousDisease #Epidemic #modelling for COVID-19, I'm trying to herd various fuzzy ideas into a clear narrative about how research software engineering (#RSE) can support #Reproducibility and #ResearchQuality (in computational fields, at least). Particularly when timelines are tight.

    The essence is: mistakes will be made; how can I detect them as early as possible, fix them, and ensure they don't happen again?

    #VersionControl #SoftwareTesting

  12. I started a company this year that makes training for researchers to promote #ResearchQuality.
    Our first course is getting really good interest. It's so pleasing! If you know a university that could do with better #ResearchIntegrity training, could you let them know we exist?
    trickygoose.training/
    cheers!