home.social

#reproducibilitycrisis — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #reproducibilitycrisis, aggregated by home.social.

fetched live
  1. « this discrepancy is a root cause of the #ReproducibilityCrisis. »

    Please do not hide 🫣 behind technical means!

    As scientific practitioners, it’s simple (but not easy!):

    (1) Degrowth our outcome; for a better quality and a lower quantity

    (2) Adopt and promote current practises that already help

    The rule of thumb:

    If our grandchildren cannot verify in the future our findings of today, then such findings aren’t scientific findings but findings of alchemists, wizards, sorcerers, occultists or warlocks.

    scholarlykitchen.sspnet.org/20
    #ReproducibleResearch #OpenScience
    3/3

  2. Our latest piece on the reproducibility crisis. If we want to be serious, we will need to perform actual research to establish whether there is one and if there is, how big the problem actually is. Only with this knowledge, we can design effective measures and monitor their success. #reproducibility #ReproducibilityCrisis #academia #research #LifeSciences

    tandfonline.com/doi/full/10.10

  3. Science, particularly the biomedical branch, suffers from a #reproducibilitycrisis. Elizabeth Bik from microbiomedigest.com/ who is one of the best known science sleuths (and alas still on X). Has received the Einstein Award - along with #PubPeer: award.einsteinfoundation.de/aw

  4. For the next few months, Dr. Andrej-Nikolai Spiess (openalex.org/works?page=1&filt) will be a guest in my working group.

    We are working on a paper where we show that 29 % of papers in top journals like Science, Nature & PNAS were skewed by a single influential data point! Time to rethink our reliance on p-values and explore alternative measures like #dfstat. #reproducibilitycrisis #linearregression #rstats

    Moreover, we will work on #qPCR related software like PCRedux (joss.theoj.org/papers/10.21105)

    #JOSS

  5. the idea in nature.com/articles/s43856-024 is interesting, but the code (doi.org/10.5522/04/25541392.v1) can't be rerun

    At least they posted it. It's a start, but it's the same as a recipe for a cookbook that tells you to add in some secret spices, and you're wondering "which ones?"

    #reproducibilitycrisis #incentivescrisis

  6. CW: Mild swearing, scammy behaviour

    @fernand0 it is now 19 years from “Get me off your fucking mailing list” (Mazières and Koehler, 2005)… and there are far more tools and incentives now in support of the scams than the journals.

    See vox.com/2014/11/21/7259207/sci

    Original at scs.stanford.edu/~dm/home/pape

    #PeerReview #FakeScience #ReproducibleResearch #ReproducibilityCrisis

  7. I have thought of refusing to review manuscripts which do not provide the underlying data or code that the conclusions are based upon.
    The technical difficulty is that one only can verify this after accepting the review so I haven't been able to carry this through systematically.

    Last week I reviewed a manuscript for an #Elsevier journal Marine Micropaleontology. In my review I explained the need to provide the original data and document statistical analyses, as only their conclusions (significant/not) were provided. I (think I) explained politely why this is not reproducible and recommended a revision.

    This entire part of my review was omitted from the decision sent to the authors and only the least significant comments on some details were passed on.
    What would you do @academicchatter #openscience #reproducibilitycrisis

  8. It was an interesting few weeks, but it looks like the #lk99 story has been told. No superconductor for us, but a great example of science working the way it's supposed to. Yay for #reproducibility
    nature.com/articles/d41586-023
    #reproducibilitycrisis #openscience #science

  9. CW: Long thread/6

    #10yrsago San Diego cop smashes phone & beats up suspect: “Phones can be converted to a weapon. Look it up online.” youtube.com/watch?v=qbUvvyXoEx

    #5yrsago China escalates the war on jaywalkers with automated shouting laser/squirtguns tied to motion-sensors straitstimes.com/asia/east-asi

    #5yrsago Koch-backed #ClimateDeniers are exploiting the #ReproducibilityCrisis to discredit climate science wired.com/story/sciences-repro

    6/

  10. New posting! A riff on the dream of community-led feedback on research findings, the #ReproducibilityCrisis, the problem of policing data integrity, and one possible alternative - that we all make an effort to praise and highlight good-quality work when we encounter it. Hope you like it.

    totalinternalreflectionblog.co

  11. “Thus, more than 97% of the 41 manuscripts did not present the raw data supporting their results when requested by an editor”

    “No raw data, no science: another possible source of the reproducibility crisis.” molecularbrain.biomedcentral.c

    #reproducibility #reproducibilitycrisis #rawdata #molecularbrain #miyakawa

  12. Talk: Leakage and the Reproducibility Crisis in ML-based Science by @sayashk

    Online or in person at Exeter
    exeter.ac.uk/news/events/detai

    "There are many known methodological pitfalls, including data leakage, in ML-based science. In this paper, we systematically investigate reproducibility issues in ML-based science. We show that data leakage is indeed a widespread problem and has led to severe reproducibility failures."

    #MachineLearning #DataScience #ReproducibilityCrisis #OpenScience

  13. #baudrillard "reality is that which can be copied"

    This makes #kopimi pretty compelling. If all there is, is copies...why would kopimi be a false religion?

    "pornographic films will become 3d, ...reproducible to infinity..." so freudianism is irrelevant since you just pursue your ego to infinitum. In fact why do anything, if you can get away with this ultrareal wirehead ecstasy ?

    "Children are much more emotionally involved with nintendo than you are with your aunts, brothers, etc."...that the "next" generation (ie today's *last* generation) is from another world because the peers of a child are, to 20th century, is a machine.

    "Before we knew all the changes they would make"

    "everyone's so polite" in hyperreal europe (aka disneyland), compared to real europe

    The heritage of social theory and philosophy has transferred to advertisement. 1993-Stephen Hawking shouldn't have been complaining about philosophers, he should have been complaining about 1993 advertisers.

    I wonder if we're going to forget baudrillard because of stuff like the matrix making his ideas more real than his original french.

    The Rodney king riots as a 'hyperreal' event. This suggests #blacklivesmatter is really about black lives mattering not because black lives matter per se, but because 'black lives matters' matters. It's exciting! It's not boring! It's putting you on the front lines of a cultural battle, on the winning side! And you don't even have to let black lives matter to your day to day life to do it, as that would actually be difficult and icky.

    'We don't really see black people...but we hear rap music, and get afraid, at the projection of what they are' - that most of what poasters, say, don't like is a media construction, one they are helping to create.

    "I've been in compton, they don't have a drive by every 2 minutes...but I can't prove it" - the #reproducibilitycrisis in a nutshell. Do masks work? Does covid even *exist*? How do you prove such things, and what does it mean to prove them, in a world with paywalls etc?

    Baudrillard covered the gulf war the way marshall mcluhan would have - he watched american TV. His conclusion: war was the war on the 'vietnam syndrome', a war against the memory that war was real. The hyperreal feeling of continuing success of our technology, and moral equivalent of sportscasters comments, when the scorecard for the day would be rolled out, much like a sports game.

    This is what the Taliban broke. Or did they?

    The little individual actors couldn't make sense of their experiences without the TV to tell them what exactly they just experienced. The war was "just like video games I played". The real thing was the video game characters, the war was just a copy.

    The thrill of rapping the game as the pinnacle of human experience.

    The most powerful political rhetoric in a postmodern society : "It's just that simple" - simplifying worldviews, soundbytes, etc "I know it's complicated, but we can fix it" is a variant of this

    My week as a trotskiest
    ...these are papers you could expect to read if people still read/wrote ,and as of 1993 he claimed they didn't.

    Between castro, qadafi, bill clinton...clinton would lose, as of 1993

    An ad on laserdisk, with scarlet o'hara living her whole life, only one scene with a big mac being eaten. The add is the whole movie. The part that's actually an advertisement fades into the background - we just consume ads because it's just what we do. I wonder if this kind of ads will come to the net. Imagine a whole ARG world that's an ad for mcdonalds, where the aren't even any mcdonalds burgers or anything recognizably mcdonalds in it - just a world that is a lie to keep us hungry and distracted.

    The struggle of the future isn't the upper class vs the lower class, the womens vs the patriarchy, but the real vs the hyperreal --- I would then add a twist to this : at every level of hyperreal there's a level below it that people disagree on https://xkcd.com/1095/

    That context is where the battle is.

    The battle lines are between 'Anonymous forces that have been unleashed by a technology that grew out of Capital, that will be controlled by not very many people, and people who still would like to have experience....that would make them archaic old fuddy duddies

    A revolution of 'let's actually make love instead of getting in our 3d sex machines'...that would be a revolution.

    It may be a revolution in politics if a political candidate believed a single thing.

    Part of baudrillard is to recognize the humour in the situation. We've built this machine that consumes leisure time, and feeds us nightmares in return. It's kinda hard to describe in text, but it is funny to watch if you're an outsider.

    Follow cyberpunk artifacts. Blade runner.
    The poor still crawl in the postmodern cracks and sleep at night.

    And an alarming lack of sympathy, because their existence proves the lack of simplicity

    #2U9WMftV40c