#systematicreviews — Public Fediverse posts

3/

On the second point (to me, perhaps even more fundamental, as truly understanding #context is a prerequisite for intelligence):

"conducting #SystematicReviews is not a purely computational task. Human specialists are needed to define meaningful review questions, evaluate relevance, interpret results and understand clinical or policy implications. Context and subjective nuance are seldom well-represented in AI models’ training data, and the" #GenAI models do "fabricate information" [1]

3/

On the second point (to me, perhaps even more fundamental, as truly understanding #context is a prerequisite for intelligence):

"conducting #SystematicReviews is not a purely computational task. Human specialists are needed to define meaningful review questions, evaluate relevance, interpret results and understand clinical or policy implications. Context and subjective nuance are seldom well-represented in AI models’ training data, and the" #GenAI models do "fabricate information" [1]

1/
Commentary on #GenAI / #SyntheticTextExtrudingMachines use within #scientific reviews [1]

Relevance:
"The stakes are high.
#SystematicReviews and other types of evidence synthesis inform clinical practice, public-health guidance and policy decisions that affect entire populations. Errors could give false hope to patients or lead health systems to waste money on ineffective or unsafe interventions"

Among the points:

- privately-owned tools vs independence from industry

- tools miss context

1/
Commentary on #GenAI / #SyntheticTextExtrudingMachines use within #scientific reviews [1]

Relevance:
"The stakes are high.
#SystematicReviews and other types of evidence synthesis inform clinical practice, public-health guidance and policy decisions that affect entire populations. Errors could give false hope to patients or lead health systems to waste money on ineffective or unsafe interventions"

Among the points:

- privately-owned tools vs independence from industry

- tools miss context

Die unter den Sammelbegriffen Lern(um)welten geführte Forschungsliteratur ist vielfältig und kaum noch überschaubar.
Im Dossier "Forschung zu digitalen Lern(um)welten" versammeln wir neben einführender Literatur insbesondere #SystematicReviews, #Forschungssynthesen und Literaturüberblicke, die zentrale Diskussionslinien bündeln. Ergänzend werden ausgewählte #Forschungsprojekte und #Forschungsdaten berücksichtigt. https://www.fachportal-paedagogik.de/forschungsinformation/forschung-zu-digitalen-lern-um-welten-13277-de.html
#DBSAktionswochen #Lernumwelten #Digitalisierung

Die unter den Sammelbegriffen Lern(um)welten geführte Forschungsliteratur ist vielfältig und kaum noch überschaubar.
Im Dossier "Forschung zu digitalen Lern(um)welten" versammeln wir neben einführender Literatur insbesondere #SystematicReviews, #Forschungssynthesen und Literaturüberblicke, die zentrale Diskussionslinien bündeln. Ergänzend werden ausgewählte #Forschungsprojekte und #Forschungsdaten berücksichtigt. https://www.fachportal-paedagogik.de/forschungsinformation/forschung-zu-digitalen-lern-um-welten-13277-de.html
#DBSAktionswochen #Lernumwelten #Digitalisierung

"Mastering the Art of Systematic Literature Review: Techniques, Tools, and Best Practices"
https://video.fernuni-hagen.de/Play/32378#!
– Vortrag für Studierende von Prof. Dr. Nosheen Fatima Warraich, Professorin am Institut für Informationsmanagement der University of the Punjab in Lahore (Pakistan) und Senior Fellow der Münsteraner Kolleg-Forschungsgruppe „Zugang zu kulturellen Gütern im digitalen Wandel“.
(https://www.uni-muenster.de/KFG-Zugang/person/warraich.html)
[via https://www.uni-muenster.de/KFG-Zugang/transfer/]
#SystematikLiteratureReviews #SystematicReviews #SLR

"Mastering the Art of Systematic Literature Review: Techniques, Tools, and Best Practices"
https://video.fernuni-hagen.de/Play/32378#!
– Vortrag für Studierende von Prof. Dr. Nosheen Fatima Warraich, Professorin am Institut für Informationsmanagement der University of the Punjab in Lahore (Pakistan) und Senior Fellow der Münsteraner Kolleg-Forschungsgruppe „Zugang zu kulturellen Gütern im digitalen Wandel“.
(https://www.uni-muenster.de/KFG-Zugang/person/warraich.html)
[via https://www.uni-muenster.de/KFG-Zugang/transfer/]
#SystematikLiteratureReviews #SystematicReviews #SLR

Comparison of Elicit AI and Traditional Literature Searching in Systematic Reviews using Four Case Studies | medRxiv
#artificialintelligence #SystematicReviews
https://www.medrxiv.org/content/10.1101/2025.06.17.25329772v1

Jetzt anmelden zum @DGIInfo -Workshop "Systematische #Forschungssynthesen – Methode und Aufgaben für #Bibliotheken" am 7. und 14. Juli. Der Workshop führt in die einzelnen Prozessschritte sowie die Datendokumentation und Qualitätsprüfung ein und stellt verschiedene Typen von #SystematicReviews vor. Die Teilnehmenden erhalten einen detaillierten Überblick über die Aufgaben bei einem Systematic Review und erproben einzelne Schritte in kleinen Übungen.
https://dgi-info.de/event/systematische-forschungssynthesen-methode-und-aufgaben-fuer-bibliotheken/

Jetzt anmelden zum @DGIInfo -Workshop "Systematische #Forschungssynthesen – Methode und Aufgaben für #Bibliotheken" am 7. und 14. Juli. Der Workshop führt in die einzelnen Prozessschritte sowie die Datendokumentation und Qualitätsprüfung ein und stellt verschiedene Typen von #SystematicReviews vor. Die Teilnehmenden erhalten einen detaillierten Überblick über die Aufgaben bei einem Systematic Review und erproben einzelne Schritte in kleinen Übungen.
https://dgi-info.de/event/systematische-forschungssynthesen-methode-und-aufgaben-fuer-bibliotheken/

otto-SR | Automated Systematic Reviews with AI Agents https://ottosr.com #AI #SystematicReviews

otto-SR | Automated Systematic Reviews with AI Agents https://ottosr.com #AI #SystematicReviews

Ever wondered what to do with the >80k citations of the PRISMA standards for #SystematicReviews and #MetaAnalysis?

I did a bibliometric analysis of authors who use PRISMA. Join my presentation next week:

https://social.cwts.nl/@cwts/114274695842290362

Ever wondered what to do with the >80k citations of the PRISMA standards for #SystematicReviews and #MetaAnalysis?

I did a bibliometric analysis of authors who use PRISMA. Join my presentation next week:

https://social.cwts.nl/@cwts/114274695842290362

When we talk about grey literature, do we also consider grey information and grey data? I usually define it as conference papers, dissertations, and preprints only.

A worthwhile read on this topic: https://doi.org/10.1186/s13643-016-0337-y

#SystematicReview #SystematicReviews #SysRev #metaanalysis

When we talk about grey literature, do we also consider grey information and grey data? I usually define it as conference papers, dissertations, and preprints only.

A worthwhile read on this topic: https://doi.org/10.1186/s13643-016-0337-y

#SystematicReview #SystematicReviews #SysRev #metaanalysis

Can anyone explain to me the relationship between the "SHOW ME the evidence" paper published in JBI Evidence Implementation, Campbell Systematic Reviews, Clinical and Public Health Guidelines, Cochrane, and Environmental Evidence in November, and the "Evidence Synthesis Infrastructure Collaborative"?
#EvidenceSynthesis #SystematicReviews

Remember Ludwig Fleck's socio-intellectual forms of science? In 1935, he described the novelty of findings along different document types that can be found in science. Today, many links between document types and intellectual functions can be identified. Think of #Preprints, #SystematicReviews #MetaAnalysis #Guidelines #Handbooks #SoftwarePaper #DataPaper etc.
(I put a little typology here: https://arxiv.org/abs/2406.15154)

Remember Ludwig Fleck's socio-intellectual forms of science? In 1935, he described the novelty of findings along different document types that can be found in science. Today, many links between document types and intellectual functions can be identified. Think of #Preprints, #SystematicReviews #MetaAnalysis #Guidelines #Handbooks #SoftwarePaper #DataPaper etc.
(I put a little typology here: https://arxiv.org/abs/2406.15154)

Researchers planning to do #SystematicReviews must now plan to filter out the #JunkScience. That's difficult, time-consuming, error-prone, and demoralizing. It causes some researchers to drop their plans and forces others to move more slowly.
https://www.science.org/content/article/systematic-reviews-aim-extract-broad-conclusions-many-studies-are-peril
(#paywalled)

#Academia #LiteratureReviews #MetaResearch #MetaScience #ScholComm
@academicchatter

Researchers planning to do #SystematicReviews must now plan to filter out the #JunkScience. That's difficult, time-consuming, error-prone, and demoralizing. It causes some researchers to drop their plans and forces others to move more slowly.
https://www.science.org/content/article/systematic-reviews-aim-extract-broad-conclusions-many-studies-are-peril
(#paywalled)

#Academia #LiteratureReviews #MetaResearch #MetaScience #ScholComm
@academicchatter

Look out for #fraudulent papers in systematic reviews… #systematicreviews #science #fraud #research

RE: https://bsky.app/profile/did:plc:3nuyftkga5q32inooxbbxa74/post/3lddeg3rqrc25

“They are poisoning the well”. It seems that more and more fake #papers creep into the literature threatening #SystematicReviews (but also #science in general…).

🧐 Not surprisingly, #PeerReview doesn't seem to be able to fend this off...

https://www.science.org/content/article/systematic-reviews-aim-extract-broad-conclusions-many-studies-are-peril

@SciMag is alarmed that low quality articles are flawing #SystematicReviews.

One solution is to only include studies that are in #opendata.

Another is to ignore #predatory and journals in the "gray zone" (e.g. all #MDPI, #Frontiers, #ScientificReports, etc.) as we already do in evaluation committees.

https://www.science.org/content/article/systematic-reviews-aim-extract-broad-conclusions-many-studies-are-peril

@SciMag is alarmed that low quality articles are flawing #SystematicReviews.

One solution is to only include studies that are in #opendata.

Another is to ignore #predatory and journals in the "gray zone" (e.g. all #MDPI, #Frontiers, #ScientificReports, etc.) as we already do in evaluation committees.

https://www.science.org/content/article/systematic-reviews-aim-extract-broad-conclusions-many-studies-are-peril

Have you ever seen an SR that did a sensitivity analysis based on only the OA included papers? Or even pointed out how many of the included papers are OA? Would love to read examples, don't care if they included only version of record OA or not.
#EvidenceSynthesis #SystematicReviews #OA #OpenAccess

Have you ever seen an SR that did a sensitivity analysis based on only the OA included papers? Or even pointed out how many of the included papers are OA? Would love to read examples, don't care if they included only version of record OA or not.
#EvidenceSynthesis #SystematicReviews #OA #OpenAccess

Reminder - consider subscribing to the VT Libraries research services newsletter https://news.vt.edu/notices/univlib-research-services-newsletter-launch.html #VirginiaTech #OpenAccess #DataManagement #SystematicReviews

Reminder - consider subscribing to the VT Libraries research services newsletter https://news.vt.edu/notices/univlib-research-services-newsletter-launch.html #VirginiaTech #OpenAccess #DataManagement #SystematicReviews

"Exploring the use of generative artificial intelligence in systematic searching: A comparative case study of a human librarian, ChatGPT-4 and ChatGPT-4 Turbo"
https://doi.org/10.1177/03400352241263532
#systematicreviews #GPT #ChatGPT

"Exploring the use of generative artificial intelligence in systematic searching: A comparative case study of a human librarian, ChatGPT-4 and ChatGPT-4 Turbo"
https://doi.org/10.1177/03400352241263532
#systematicreviews #GPT #ChatGPT

🔥 Just out 🔥

#PrismaCosmin 2024

A #ReportingGuideline for reporting #SysReviews of outcome measurement instruments:
https://link.springer.com/article/10.1007/s11136-024-03634-y

It aims to improve the reporting of #SystematicReviews of OMIs, fostering their reproducibility and allowing end-users to appraise the quality of OMIs.

It consists of two checklists, their corresponding explanation and elaboration documents detailing the rationale and examples for each item, and a data flow diagram.

#Psychometrics #SystematicReviews

Just learned about the Result Assessment Tool (RAT)

Is anyone using this for #GreyLit in #EvidenceSynthesis #systematicreviews ?
#medlibs

Just learned about the Result Assessment Tool (RAT)

Is anyone using this for #GreyLit in #EvidenceSynthesis #systematicreviews ?
#medlibs

Call for Manuscripts for the "Journal of Systematic #Reviews" (JSR), a newly launched #OpenAccess journal

JSR is an international, peer-reviewed, bi-annual, multidisciplinary, #OA journal devoted to all aspects of the design, conduct and reporting of #SystematicReviews, #ScopingReviews, and #MetaAnalyses.

The journal’s mission is to publish original papers which contribute to the advancement of #science, and specially the #methodology of systematic reviews.

https://digitalization.site/index.php/jsr

Call for Manuscripts for the "Journal of Systematic #Reviews" (JSR), a newly launched #OpenAccess journal

JSR is an international, peer-reviewed, bi-annual, multidisciplinary, #OA journal devoted to all aspects of the design, conduct and reporting of #SystematicReviews, #ScopingReviews, and #MetaAnalyses.

The journal’s mission is to publish original papers which contribute to the advancement of #science, and specially the #methodology of systematic reviews.

https://digitalization.site/index.php/jsr

"Why EXACTLY is Google Scholar bad for evidence synthesis, systematic reviews?" by Aaron Tay: https://musingsaboutlibrarianship.blogspot.com/2024/05/why-exactly-is-google-scholar-bad-for.html #GoogleScholar #SystematicReviews

"Why EXACTLY is Google Scholar bad for evidence synthesis, systematic reviews?" by Aaron Tay: https://musingsaboutlibrarianship.blogspot.com/2024/05/why-exactly-is-google-scholar-bad-for.html #GoogleScholar #SystematicReviews

public talk (online):

This Friday, I will present qualitative and quantitative analyses of the #PRISMA guideline for #SystematicReviews in biomedicine. I will look at standardizing science from #Sociology and #STS perspectives:

https://www.cwts.nl/seminars/announcements?article=n-t2q2a4&title=reporting-guidelines-and-their-impact-on-papers-practices-and-patterns-in-biomedical-research

@cwts

public talk (online):

This Friday, I will present qualitative and quantitative analyses of the #PRISMA guideline for #SystematicReviews in biomedicine. I will look at standardizing science from #Sociology and #STS perspectives:

https://www.cwts.nl/seminars/announcements?article=n-t2q2a4&title=reporting-guidelines-and-their-impact-on-papers-practices-and-patterns-in-biomedical-research

@cwts

Something read and reviewed, and something reviewed and published (and read, hopefully)

#books #reviews #systematicreviews #multiplesclerosis

https://neurontosomething.wordpress.com/2024/04/27/my-brain-citation-needed/

Something read and reviewed, and something reviewed and published (and read, hopefully)

#books #reviews #systematicreviews #multiplesclerosis

https://neurontosomething.wordpress.com/2024/04/27/my-brain-citation-needed/

Are you a #researcher or guideline developer who uses #ROBIS to critically appraise #systematicreviews? Join us for a live #webinar with @robertwolff to learn more about how
@ksrevidence can help you find the highest quality #evidence!

Details and register here: https://us02web.zoom.us/webinar/register/5217137899082/WN_GJiBraMtTRSFK6jvSrCy6w

Und wie sieht es #international mit dem Einsatz von #KI in der #Bildung aus? Das wird in diesem Dossier beleuchtet. Hier die Inhalte:
- Unsere TOP-5-Links zu KI & Bildung
- Überblicksliteratur & #SystematicReviews
- Berichte & Statistiken
- Organisationen & Netzwerke
- Richtlinien, Strategien, Rahmenregelungen
- Projekte
- KI und Bildung in verschiedenen Ländern & Regionen
- KI-Tools in der Bildung
https://www.bildungsserver.de/Kuenstliche-Intelligenz-KI-und-Bildung-internationale-Perspektiven-7564_ger.html
Reinschauen lohnt! 🤓

Dear @OpenAlex people and other #SysRev enthusiastics:

I'm in the process of planning a number of #SystematicReviews. It would be great if we'd be able to use #OpenAlex instead of paywalled #bibliographic databases and interfaces.

There are 2 challenges.

1️⃣ OpenAlex is huge (which is great). The Subjects can help here I guess, but open to other suggestions!

2️⃣ In OpenAlex Web, I can't figure out how to search in Titles Only. When adding a filter, 'title' isn't available...

What am I missing?

New post: A view from the Sicily Evidence-Based Healthcare Conference

https://absolutelymaybe.plos.org/2023/11/01/a-view-from-the-sicily-evidence-based-healthcare-conference/

Last week was the 10th international gathering of EBHC teachers & developers in Sicily. I reflect on some of the major themes - "living" systematic reviews & guidelines, pandemic divisions, & equity in EBHC.

#MedMastodon #EpiVerse #Guidelines #SystematicReviews #EHBC2023

Together with the Open Learning Initiative (https://oli.cmu.edu), the Campbell Collaboration (https://www.campbellcollaboration.org) is now offering a free self-guided course on Systematic Reviews and Meta-Analysis: https://oli.cmu.edu/courses/systematic-reviews-and-meta-analysis-o-f/ This looks like an excellent resource!

#MetaAnalysis #SystematicReviews

Glad to join #STI2023 in Leiden this year!

I'll bring an analysis of academic age of users of #ReportingGuidelines, especially PRISMA for #SystematicReviews.

Why academic age? --> Time in the field and level of experience may be correlated to what you write.
Check out my short analysis:

https://dapp.orvium.io/deposits/6441b6d076bb0bb2c9ff4c15/view

Systematic review and Covidence question:

When setting up a Covidence project in which a lead researcher will screen 100% of papers, and a second person will screen 10%, is it better to set up the 'reviewers required to screen' as 1 or 2?

Bonus question: if someone has already screened with the 'reviewers required to screen' set at 1, can a second person still review 10%? Or has that horse bolted, at least for that Covidence project? Thanks!

#SystematicReviews
#Covidence

Hey @academicchatter and @phdstudents !

Please consider working with a #librarian or #informationist to help you brainstorm author supplied keywords for your next manuscript. Our expertise in searching will help guarantee your research is returned in searches for #SystematicReviews and other #EvidenceSynthesis projects, and therefore cited in those same projects. Not to mention better term selection makes for higher recall (and therefore more citations!).

@medlibs #medlibs