home.social

#data-integrity — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #data-integrity, aggregated by home.social.

fetched live
  1. Tried backing up my 100Gb ssd home directory in linux onto a HP usb thumb drive usb a/c and about 400 files were allegedly corrupted in the rsynch copy as evidenced by same write data etc. but different check sum. Is this normal for ?

  2. @[email protected] @[email protected] @[email protected]

    There are two types of excel in the office:

    • Excel sheet that should be a webform
    • Excel sheet that should be a database

    There are contractors who make their living turning excel sheets into databases, usually by dovetailing it under some "move to cloud" or "become AI ready" initiative. There are plenty of python frameworks to help with this, and pretty web front-ends sell well with the Panicking Business Majors.

    At the very least, I'm learning to script the work for myself on my machine. I've had too many situations where my boss wouldn't greenlight a modernization project. Step one is to make it reasonable for myself, step two is to find a better boss.


    #excel #python #data-integrity
  3. Day 290

    If a journalist eventually finds it, the story waiting for them is no longer “Amazon misspelled an actor’s name.”

    It is:

    “A German woman spent nearly a year documenting a systemic catalogue-integrity problem while every major stakeholder said, in one form or another, that responsibility belonged somewhere else.”

    is.gd/AmazonDEMetadata

    #namesmatter #respecttheartist #metadata #dataintegrity #amazon #datagovernance #dataownership #qualityassurance #qafail #metadatamess #breakingnews

  4. After the backup scares and bit rot posts, I built LumiVault — a macOS app that hashes, error-corrects, and mirrors my photos across drives and B2. Free and open source. (370 words)
    #photography #backup #dataintegrity #datapreservation #dataprotection #reedsolomon #posse

    🔗 behindtheviewfinder.com/lumiva

  5. RE: mastodon.social/@TanjaStrange/

    Day 268

    The #Entertainment industry has no clue about how wide spread this issue is. International platforms, broken contributor IDs & incomplete search results because of it.

    When will anyone start owning this problem?

    #metadata #namesmatter #dataintegrity #amazon #news #technology #qualityassurance #icymi

  6. New article: The Silent Takeover: How Bot Traffic Surpassed Humans on the Internet — an evidence-based look at how automated traffic now dominates web visits, the consequences for analytics and ad spend, and concrete steps teams can take to adapt. Read more: wix.to/3YSxueX

    #AdTech
    #DataIntegrity
    #WebAnalytics
    #CyberSecurity
    #DigitalStrategy

  7. 🎉 Behold the #genius of reinventing Raft consensus with an even LOWER bar for participation! 🎉 Now, fewer than a majority of nodes can decide fate, as long as you pick the right minority. 🙃 It's like playing Spot It Dobble, but with your data's integrity on the line. 🤔💥
    padhye.org/raft-minority/ #RaftConsensus #Innovation #LowParticipation #DataIntegrity #HackerNews #ngated

  8. AI is only as good as the data behind it.

    Incomplete recordings = unreliable insights.

    That’s why Revcord focuses on secure, dependable recordings first—then builds AI tools like ReVI on top of that foundation.

    #AI #PublicSafety #DataIntegrity

  9. ❗Update on Plagiarism and Falsification in Scientific Publications

    Today, I officially submitted requests for the retraction of articles to the editorial boards of the journals "Land Reclamation and Water Management" and "Bulletin of NUWM".

    ❗Key facts of misconduct:
    🔹 Plagiarism: Unauthorized use of my original relief map (2015) without citation.
    🔹 Falsification: Intentional removal (retouching) of the author’s stamp with coordinates and date-time on site photographs.
    🔹 Duplication: Publication of identical material in 2021 and 2024.

    Next steps:
    In the event of attempts to covertly remove the articles without an official retraction notice, relevant complaints will be forwarded directly to @crossref and the international members of the editorial boards.

    #OpenScience #ResearchMisconduct #AcademicMastodon #ScientificIntegrity #Hydrology #Geoscience #GIS #FediScience #Plagiarism #SvystunovaGully #COPE #Crossref #DataIntegrity #ImageManipulation #AcademicChatter #ResearchEthics #EarthScience #HigherEducation

  10. ❗ While preparing a literature review for my monograph on the hydrogeochemical impact of mine waters, I discovered the unauthorized use of my original materials in articles published in 2021 and 2024. Both publications were prepared with the primary involvement of staff from the Institute of Water Problems and Land Reclamation of the National Academy of Agricultural Sciences of Ukraine (IWPLR NAASU).

    An analysis revealed facts that go beyond a simple copyright violation:
    🔹 Data Falsification: Original photo metadata (date, time, GPS) was intentionally retouched to conceal their 2015 origin and authorship.
    🔹 Methodological Anachronism: Using 2015 data for 2024 modeling renders results invalid by ignoring the major infrastructure overhaul launched in early 2025.
    🔹 Institutional Failure: This misconduct by state academy staff signals a systemic collapse of research quality control and ethical oversight within the institutions.

    #ScientificMisconduct #SvystunovaGully #ResearchEthics #DataIntegrity #Plagiarism

  11. 🚀🎩 Behold! The magical realm of Lakehouse architecture! Apparently, disabling FPW in #Postgres speeds up writes by 5x—because who needs data integrity anyway, right? 🙄 Meanwhile, the #Databricks blog is a masterclass in how to disguise a sales pitch as an innovation breakthrough. 🤑
    databricks.com/blog/how-lakeba #LakehouseArchitecture #DataIntegrity #InnovationBreakthrough #HackerNews #ngated

  12. RE: mastodon.social/@arstechnica/1

    This technique is commonly used for insider detection. Plant a unique canary in a datasource someone has access to and see which canary shows up and you have the leaker.

    Another technique inverted to this purpose to spot manipulation without using obvious hashes or digital signatures is to insert a specific message into a plaintext that may be formatted wrong or not comply with the uniformity then get a HMAC signature out of it. Loop through the data and check if the MAC is created. This is called Chaffing and Winnowing:
    en.wikipedia.org/wiki/Chaffing

    #cryptography #insiderdetection #espionage #dataintegrity #manipulation

  13. Transaction logs enable point-in-time recovery in financial databases. By replaying log entries up to a specific moment, a system can reconstruct its exact state before a failure, data corruption, or erroneous transaction.

    #TransactionLog #Fintech #DataIntegrity

  14. Pessimistic Locking is a concurrency control strategy that locks a resource before accessing it. It assumes conflicts are likely, preventing other transactions from reading or modifying locked data until the lock is released.

    #DistributedSystems #Fintech #DataIntegrity

  15. Day 200.

    This was never a typo.
    It’s a systemic metadata failure affecting identity, visibility, and revenue.

    And no one owns it.

    📄 Full report: is.gd/day200summary

    #namesmatter #metadata #dataintegrity #amazonfail #systemicfailure

  16. I tried to explain a systemic problem to:

    • a system that can’t process systems ❌

    And got understood by:
    • a system that specializes in understanding systems ✔️

    #namesmatter #metadatafailure #amazonfail #dataintegrity #technology #qualitymanagement #audit #entertainment

  17. Day 190 of my #investigation into Amazon’s #systemicmetadata failure.

    What started as a typo turned out to be something else entirely:
    A system that fragments identities, breaks discoverability, and quietly disconnects artists from their own work.

    That’s not just messy.
    That’s a data integrity problem with real-world impact.

    Full findings:
    is.gd/AmazonDEMetadata

    Satirical audit report:
    is.gd/auditreport

    You’re being audited.

    #namesmatter #dataintegrity #ICYMI #technology #amazonfail

  18. @OpenCloud

    Congratulations. This is another major step forward in the battle to tame the EU AI Act Compliance beast. Accountable Hardware meets sovereign Cloud.

    We should have a chat (soon) about structured indexing of large unstructured datasets. I have some novel. and very fast, tools under development right now.

    #DigitalSovereignty #EUAIAct #SovereignCloud #OCIS #ConfidentialComputing #DigitalForensics #IPCEICIS #OpenSource #DataIntegrity #StructuredIndexing

  19. Oh, the joy of handing SQL access to every user on a shared #ClickHouse cluster! 🎉 Because nothing says "secure and efficient" like letting everyone wreak havoc on a communal database. 🤦‍♂️ But hey, who needs data integrity when you can have chaos? 🚀
    trigger.dev/blog/how-trql-works #SQLAccess #SharedDatabase #DataIntegrity #Chaos #HackerNews #ngated