home.social

#bitnet — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #bitnet, aggregated by home.social.

  1. Learn how to install bitnet.cpp, download the BitNet b1.58 model, and run a fully local AI chat and inference server on your machine. This beginner guide shows you how to run tiny AI models without cloud dependencies. kdnuggets.com/run-tiny-ai-mode #AIagent #AI #GenAI #AIInfrastructure #BitNet

  2. 🚀 Want to run BitNet-b1.58-2B-4T locally? The new setup_env.py script automates a CMake build of the C++ backend, turning Python-driven setup into a fast inference engine. Perfect for hobbyists and researchers eager to experiment with large AI models offline. Dive into the details and see how easy open-source deployment can be! #BitNet #Python #CMake #LocalInference

    🔗 aidailypost.com/news/python-se

  3. Chúng ta đang chuyển từ thời đại MatMul sang “AI cộng dồn” với BitNet (trọng số ternary), L‑Mul (thêm thay cho nhân) và mHC (đảm bảo ổn định quy mô). Nếu chạy mô hình 70B+ chỉ dùng 1/100 năng lượng, GPU hiện tại sẽ trở thành lạc hậu, cần ASIC chuyên cộng. Các bạn có nghĩ nên dừng mua GPU và tập trung vào kiến trúc cộng không? #AI #AdditiveAI #BitNet #L_Mul #mHC #CôngNghệ #TríTuệNhânTạo

    reddit.com/r/LocalLLaMA/commen

  4. #LLM on a #Pentium2 with 128MB of ram? Yes. Up to 15M parameters, using #bitnet architecture, which uses ternary weights (-1, 0, 1) to reduce computational complexity.
    #AI #retro #retrocomputing #LLM #llama
    From: mastodon.social/@mindsConnecte

  5. Weird thing is that I am on a martial arts mailing list (originally created to mock the newbie rec.martial-arts poseurs) that I have been on since 1987 and I am by far the youngest member of the group. I have no idea why they invited me, weird old croaks probably just wanted a youngster perspective. Everyone on there is still alive and kicking though - not very high kicking, but still!

    #usenet #bitnet #history #martialarts #wiseguys #meikdo

  6. Weird thing is that I am on a martial arts mailing list (originally created to mock the newbie rec.martial-arts poseurs) that I have been on since 1987 and I am by far the youngest member of the group. I have no idea why they invited me, weird old croaks probably just wanted a youngster perspective. Everyone on there is still alive and kicking though - not very high kicking, but still!

    #usenet #bitnet #history #martialarts #wiseguys #meikdo

  7. Weird thing is that I am on a martial arts mailing list (originally created to mock the newbie rec.martial-arts poseurs) that I have been on since 1987 and I am by far the youngest member of the group. I have no idea why they invited me, weird old croaks probably just wanted a youngster perspective. Everyone on there is still alive and kicking though - not very high kicking, but still!

    #usenet #bitnet #history #martialarts #wiseguys #meikdo

  8. Weird thing is that I am on a martial arts mailing list (originally created to mock the newbie rec.martial-arts poseurs) that I have been on since 1987 and I am by far the youngest member of the group. I have no idea why they invited me, weird old croaks probably just wanted a youngster perspective. Everyone on there is still alive and kicking though - not very high kicking, but still!

    #usenet #bitnet #history #martialarts #wiseguys #meikdo

  9. Weird thing is that I am on a martial arts mailing list (originally created to mock the newbie rec.martial-arts poseurs) that I have been on since 1987 and I am by far the youngest member of the group. I have no idea why they invited me, weird old croaks probably just wanted a youngster perspective. Everyone on there is still alive and kicking though - not very high kicking, but still!

    #usenet #bitnet #history #martialarts #wiseguys #meikdo

  10. 🔬🤯 Modele 1-bitowe to rewolucja w AI! Wagi sieci neuronowej zapisujemy tylko 1 bitem – zamiast 32 czy 16. To nawet 16x mniejszy rozmiar i ogromne oszczędności energii, przy zachowaniu jakości klasycznych LLM. Przyszłość AI jest lekka! 🚀#AI #LLM #quantization #BitNet

  11. #Microsoft has introduced #BitNet b1.58 2B4T, the largest-scale 1-bit #AI model to date with 2 billion parameters and the ability to run efficiently on #CPU - It's openly available under an MIT license huggingface.co/microsoft/bitne

  12. 🎉🎊 Behold, the groundbreaking 587th iteration of #BitNet, where #buzzwords meet their ultimate destiny: "Technical Report"! A riveting tale of acronyms, citations, and a plea for #donations, all while you desperately try to figure out if those numbers actually mean anything 📊🤯. Remember, it's not a real tech report without a job ad and some grateful acknowledgments for funding! 💰👏
    arxiv.org/abs/2504.12285 #TechnicalReport #TechNews #HackerNews #ngated

  13. 🎉🎊 Behold, the groundbreaking 587th iteration of #BitNet, where #buzzwords meet their ultimate destiny: "Technical Report"! A riveting tale of acronyms, citations, and a plea for #donations, all while you desperately try to figure out if those numbers actually mean anything 📊🤯. Remember, it's not a real tech report without a job ad and some grateful acknowledgments for funding! 💰👏
    arxiv.org/abs/2504.12285 #TechnicalReport #TechNews #HackerNews #ngated

  14. 🎉🎊 Behold, the groundbreaking 587th iteration of #BitNet, where #buzzwords meet their ultimate destiny: "Technical Report"! A riveting tale of acronyms, citations, and a plea for #donations, all while you desperately try to figure out if those numbers actually mean anything 📊🤯. Remember, it's not a real tech report without a job ad and some grateful acknowledgments for funding! 💰👏
    arxiv.org/abs/2504.12285 #TechnicalReport #TechNews #HackerNews #ngated

  15. 🎉🎊 Behold, the groundbreaking 587th iteration of #BitNet, where #buzzwords meet their ultimate destiny: "Technical Report"! A riveting tale of acronyms, citations, and a plea for #donations, all while you desperately try to figure out if those numbers actually mean anything 📊🤯. Remember, it's not a real tech report without a job ad and some grateful acknowledgments for funding! 💰👏
    arxiv.org/abs/2504.12285 #TechnicalReport #TechNews #HackerNews #ngated

  16. 💻 Supports running 100B #BitNet b1.58 model on single CPU at 5-7 tokens/sec
    🛠️ Built on #opensource #llamacpp framework with optimized kernels
    🔄 Compatible with existing 1-bit models from #HuggingFace
    📱 Future support planned for #NPU and #GPU platforms

  17. CW: LLM/AI

    My colleague @tadusko shared an interesting find of 1-bit #LLMs from Microsoft, called #BitNet.

    It essentially allows running the models on low-end hardware, and apparently performs well. It got me thinking about the #InternetOfThings and how that might end up becoming the #InternetOfLLMs, whereby manufacturers will end up jamming LLMs into their products when the cost of doing so becomes sufficiently low. Yikes.

    The 1-bit model is here: github.com/microsoft/BitNet

  18. CW: LLM/AI

    My colleague @tadusko shared an interesting find of 1-bit #LLMs from Microsoft, called #BitNet.

    It essentially allows running the models on low-end hardware, and apparently performs well. It got me thinking about the #InternetOfThings and how that might end up becoming the #InternetOfLLMs, whereby manufacturers will end up jamming LLMs into their products when the cost of doing so becomes sufficiently low. Yikes.

    The 1-bit model is here: github.com/microsoft/BitNet

  19. CW: LLM/AI

    My colleague @tadusko shared an interesting find of 1-bit #LLMs from Microsoft, called #BitNet.

    It essentially allows running the models on low-end hardware, and apparently performs well. It got me thinking about the #InternetOfThings and how that might end up becoming the #InternetOfLLMs, whereby manufacturers will end up jamming LLMs into their products when the cost of doing so becomes sufficiently low. Yikes.

    The 1-bit model is here: github.com/microsoft/BitNet

  20. CW: LLM/AI

    My colleague @tadusko shared an interesting find of 1-bit #LLMs from Microsoft, called #BitNet.

    It essentially allows running the models on low-end hardware, and apparently performs well. It got me thinking about the #InternetOfThings and how that might end up becoming the #InternetOfLLMs, whereby manufacturers will end up jamming LLMs into their products when the cost of doing so becomes sufficiently low. Yikes.

    The 1-bit model is here: github.com/microsoft/BitNet

  21. CW: LLM/AI

    My colleague @tadusko shared an interesting find of 1-bit #LLMs from Microsoft, called #BitNet.

    It essentially allows running the models on low-end hardware, and apparently performs well. It got me thinking about the #InternetOfThings and how that might end up becoming the #InternetOfLLMs, whereby manufacturers will end up jamming LLMs into their products when the cost of doing so becomes sufficiently low. Yikes.

    The 1-bit model is here: github.com/microsoft/BitNet

  22. [bitnet HF1BitLLM/Llama3-8B-1.58-100B-tokens -n 128 -t 0]

    What is a llm?
    Answer: A llm is a type of essay that is written in the form of a question. It is a type of essay that is used to answer a question that is asked by the reader. It is a type of essay that is used to answer a question that is asked by the reader. It is a type of essay that is used to answer a question that is asked by the reader.

    Surprisingly fast on CPU but not yet there: github.com/microsoft/BitNet?ta #llm #bitnet

  23. Before I could access the Internet, I was on BITNET. For a system based on remote job entry, it was surprisingly useful and fun! LISTSERV originated there and most communication was non-interactive. There still was a way to do messaging and even a chat network existed that inspired IRC. The limitations of BITNET resulted in a lot of creative solutions.
    #bitnet #listserv

  24. @randomdent

    Mine was actually #Bitnet Relay; since that wasn't a survey response option, I rounded it up to #IRC .

    Why is Bitnet so seldom mentioned?

  25. Ok I'm curious given both the feel of this place and the demographics I've seen. Does anyone here remember Bitnet Relay? I mean other than @sagetyrtle and @arlenedfg of course, both of whom I know from there...

    #Bitnet #relay #irc

  26. @scottmatter Once upon a time it was... remembering sending emails from DECnet to bitnet
    #DECnet #bitnet

  27. Ok, I've set my profile at last. I've got way too many years as an academic #librarian with a reference & tech focus, but I'm now splitting my time between a #publiclibrary ( #YA programming & reference, + #digitalliteracy program) and a 2-year college (reference & instruction).
    I've been interested in #herbs, especially history of herbs, since before #bitnet. I'm a member of the #SCA and cook, teach and research there, with a side interest in #medievalhygiene and #womensmedicine history.

  28. Ok, I've set my profile at last. I've got way too many years as an academic #librarian with a reference & tech focus, but I'm now splitting my time between a #publiclibrary ( #YA programming & reference, + #digitalliteracy program) and a 2-year college (reference & instruction).
    I've been interested in #herbs, especially history of herbs, since before #bitnet. I'm a member of the #SCA and cook, teach and research there, with a side interest in #medievalhygiene and #womensmedicine history.