home.social

#floating-point — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #floating-point, aggregated by home.social.

fetched live
  1. Ah yes, another riveting tale of microcontrollers—because who doesn't love a deep dive into floating point #arithmetic on a #hobbyist chip? 🙄 Spoiler: if you enjoy endless links leading to nowhere and cryptic jargon, this post is your Disneyland. 🎢 Go ahead, embrace the thrill of being hopelessly confused! 🤓
    danielmangum.com/posts/floatin #microcontrollers #floatingpoint #techhumor #confusion #HackerNews #ngated

  2. 🚀✨ Behold, the thrilling tale of querying 3 billion vectors—a journey where Vicki Boykis heroically attempts to decode Jeff Dean's cryptic wisdom on #mapreduce. Spoiler: It's basically a nerdy treasure hunt for semantically similar items, but with more floating-point numbers than your brain can handle. 💻🧠
    vickiboykis.com/2026/02/21/que #HackerNews #VickiBoykis #treasureHunt #techJourney #floatingPoint #HackerNews #ngated

  3. 0.1 + 0.2 In SQL = 0.30000000000000004?!

    SQL floating point precision is broken! Adding 0.1 + 0.2 creates a number with precision errors. This breaks financial calculations! Watch!

    #sql #sqltricks #database #sqltutorial #floatingpoint #precision #sqlquiz #codingchallenge #sqlshorts #sqlbugs #numericprecision #sqlwtf

    youtube.com/watch?v=C53FQIhge3U

  4. Learn about numeric data types (and the number 998,001) in Python

    The value 1 / 998,001 has an interesting property, but to see it in Python you need to learn about numeric data types.

    rodstephensbooks.com/many_digi

    #Python #FloatingPoint #Decimal #Precision

  5. Проектирование FPU блока, работающего на частоте 7 ГГц

    Данный проект представляет собой современный вычислительный блок, предназначенный для обработки научных и графических данных на сверхвысокой частоте 7 ГГц . Архитектура построена на базе 128-битных векторов и 5-стадийного конвейера.

    habr.com/ru/articles/993270/

    #floatingpoint #floating_point

  6. Il faudrait un diplôme avant d'autoriser l'utilisation des nombres à virgule flottante.

    #floatingpoint #ieee754