#asapbio — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #asapbio, aggregated by home.social.
-
Six #ASAPbio fellows asked four #LLMs to describe the strengths and weaknesses of #preprints. Here are the results.
https://asapbio.org/interim-findings-from-an-investigation-into-llm-responses-about-preprints-a-2025-asapbio-fellows-project/The same fellows asked the same LLMs to ingest six preprints and their #PeerReviewed counterparts, and compare them for quality and rigor. Good question. But they've not yet analyzed the data and will presumably report soon.
PS: I'm interested in a related question. When LLMs answer research questions, do they treat on-topic preprints and on-topic postprints (peer-reviewed articles) as equivalent in weight or credibility? If not, how exactly do they take any differences into account?