home.social

#localllms — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #localllms, aggregated by home.social.

  1. Mein #arbeitgeber labert grade in so nem #MicrosoftTeams Call für alle Mitarbeiter was von #digitalesouveranitat und dann soll ich MEHR mit #microsoft #github #copilot machen. Und selbstverständlich wird ALLES #ai. Sogar unsere TLD wechselt von .net auf .ai.
    Wir sollen ganz explizit doch bitte #ki in die tägliche #Arbeit einbinden, der Vertrieb soll sich beim. Aber bloß "unsere" nutzen, wegen den Daten. Muss mich gleich mal informieren, ob #localLLMs erlaubt sind.
    hessen.social/@Moonstone2487/1

  2. Mein #arbeitgeber labert grade in so nem #MicrosoftTeams Call für alle Mitarbeiter was von #digitalesouveranitat und dann soll ich MEHR mit #microsoft #github #copilot machen. Und selbstverständlich wird ALLES #ai. Sogar unsere TLD wechselt von .net auf .ai.
    Wir sollen ganz explizit doch bitte #ki in die tägliche #Arbeit einbinden, der Vertrieb soll sich beim. Aber bloß "unsere" nutzen, wegen den Daten. Muss mich gleich mal informieren, ob #localLLMs erlaubt sind.
    hessen.social/@Moonstone2487/1

  3. Mein #arbeitgeber labert grade in so nem #MicrosoftTeams Call für alle Mitarbeiter was von #digitalesouveranitat und dann soll ich MEHR mit #microsoft #github #copilot machen. Und selbstverständlich wird ALLES #ai. Sogar unsere TLD wechselt von .net auf .ai.
    Wir sollen ganz explizit doch bitte #ki in die tägliche #Arbeit einbinden, der Vertrieb soll sich beim. Aber bloß "unsere" nutzen, wegen den Daten. Muss mich gleich mal informieren, ob #localLLMs erlaubt sind.
    hessen.social/@Moonstone2487/1

  4. Mein #arbeitgeber labert grade in so nem #MicrosoftTeams Call für alle Mitarbeiter was von #digitalesouveranitat und dann soll ich MEHR mit #microsoft #github #copilot machen. Und selbstverständlich wird ALLES #ai. Sogar unsere TLD wechselt von .net auf .ai.
    Wir sollen ganz explizit doch bitte #ki in die tägliche #Arbeit einbinden, der Vertrieb soll sich beim. Aber bloß "unsere" nutzen, wegen den Daten. Muss mich gleich mal informieren, ob #localLLMs erlaubt sind.
    hessen.social/@Moonstone2487/1

  5. Mein #arbeitgeber labert grade in so nem #MicrosoftTeams Call für alle Mitarbeiter was von #digitalesouveranitat und dann soll ich MEHR mit #microsoft #github #copilot machen. Und selbstverständlich wird ALLES #ai. Sogar unsere TLD wechselt von .net auf .ai.
    Wir sollen ganz explizit doch bitte #ki in die tägliche #Arbeit einbinden, der Vertrieb soll sich beim. Aber bloß "unsere" nutzen, wegen den Daten. Muss mich gleich mal informieren, ob #localLLMs erlaubt sind.
    hessen.social/@Moonstone2487/1

  6. Just a note for parallel universe me: flash attention is bad for #LocalLLMs

  7. Just a note for parallel universe me: flash attention is bad for #LocalLLMs

  8. Just a note for parallel universe me: flash attention is bad for #LocalLLMs

  9. So I have been trying the new #Gemma4 models on my M1 macbook pro, specifically the gemma4:26b which is 17gb in size.

    Obviously not the most challenging coding challenge and tasks but...

    Much much faster response times than local models 6-12 months ago. Previously qwen, deepseek, and even Gemm3 simply took too long to be practical.

    I find it incredible this can run on just my 5.5 year old laptop.

    #ai #llm #ollama #localllms #llms

  10. So I have been trying the new #Gemma4 models on my M1 macbook pro, specifically the gemma4:26b which is 17gb in size.

    Obviously not the most challenging coding challenge and tasks but...

    Much much faster response times than local models 6-12 months ago. Previously qwen, deepseek, and even Gemm3 simply took too long to be practical.

    I find it incredible this can run on just my 5.5 year old laptop.

    #ai #llm #ollama #localllms #llms

  11. So I have been trying the new #Gemma4 models on my M1 macbook pro, specifically the gemma4:26b which is 17gb in size.

    Obviously not the most challenging coding challenge and tasks but...

    Much much faster response times than local models 6-12 months ago. Previously qwen, deepseek, and even Gemm3 simply took too long to be practical.

    I find it incredible this can run on just my 5.5 year old laptop.

    #ai #llm #ollama #localllms #llms

  12. So I have been trying the new #Gemma4 models on my M1 macbook pro, specifically the gemma4:26b which is 17gb in size.

    Obviously not the most challenging coding challenge and tasks but...

    Much much faster response times than local models 6-12 months ago. Previously qwen, deepseek, and even Gemm3 simply took too long to be practical.

    I find it incredible this can run on just my laptop.

    #ai #llm #ollama #localllms #llms

  13. So I have been trying the new #Gemma4 models on my M1 macbook pro, specifically the gemma4:26b which is 17gb in size.

    Obviously not the most challenging coding challenge and tasks but...

    Much much faster response times than local models 6-12 months ago. Previously qwen, deepseek, and even Gemm3 simply took too long to be practical.

    I find it incredible this can run on just my 5.5 year old laptop.

    #ai #llm #ollama #localllms #llms

  14. Just so we are clear: #LocalLLMs are an asset if trained and used well. But please be aware that many projects are pretending to be open source but their releases contain closed source components where it's not transparent what is going on.

    Go to the source. Llama.cpp, PyTorch, etc.

  15. Just so we are clear: #LocalLLMs are an asset if trained and used well. But please be aware that many projects are pretending to be open source but their releases contain closed source components where it's not transparent what is going on.

    Go to the source. Llama.cpp, PyTorch, etc.

  16. Just so we are clear: #LocalLLMs are an asset if trained and used well. But please be aware that many projects are pretending to be open source but their releases contain closed source components where it's not transparent what is going on.

    Go to the source. Llama.cpp, PyTorch, etc.

  17. Just so we are clear: #LocalLLMs are an asset if trained and used well. But please be aware that many projects are pretending to be open source but their releases contain closed source components where it's not transparent what is going on.

    Go to the source. Llama.cpp, PyTorch, etc.

  18. Just so we are clear: #LocalLLMs are an asset if trained and used well. But please be aware that many projects are pretending to be open source but their releases contain closed source components where it's not transparent what is going on.

    Go to the source. Llama.cpp, PyTorch, etc.

  19. If you are running #LocalLLMs you may be using LM Studio. Just a fair warning.... While this is practical, it's also proxying everything through their infrastructure. It's a privacy nightmare.

    #lmstudio

  20. If you are running #LocalLLMs you may be using LM Studio. Just a fair warning.... While this is practical, it's also proxying everything through their infrastructure. It's a privacy nightmare.

    #lmstudio

  21. If you are running #LocalLLMs you may be using LM Studio. Just a fair warning.... While this is practical, it's also proxying everything through their infrastructure. It's a privacy nightmare.

    #lmstudio

  22. Find out which AI models your machine can actually run.

    CanIRun.ai — Can your machine run AI models? canirun.ai/

    ht @researchbuzz.bsky.social

    #LocalLLMs

  23. Find out which AI models your machine can actually run.

    CanIRun.ai — Can your machine run AI models? canirun.ai/

    ht @researchbuzz.bsky.social

    #LocalLLMs

  24. Find out which AI models your machine can actually run.

    CanIRun.ai — Can your machine run AI models? canirun.ai/

    ht @researchbuzz.bsky.social

    #LocalLLMs

  25. Find out which AI models your machine can actually run.

    CanIRun.ai — Can your machine run AI models? canirun.ai/

    ht @researchbuzz.bsky.social

    #LocalLLMs

  26. Find out which AI models your machine can actually run.

    CanIRun.ai — Can your machine run AI models? canirun.ai/

    ht @researchbuzz.bsky.social

    #LocalLLMs

  27. #Eurollm #europeanai

    mastodon.social/@silentexcepti

    👍

    Is there any initiative to pool the various initiatives across European academia and public research to come up with a common #ecosystem of #europeandata and #LocalLLMs ?

  28. #Eurollm #europeanai

    mastodon.social/@silentexcepti

    👍

    Is there any initiative to pool the various initiatives across European academia and public research to come up with a common #ecosystem of #europeandata and #LocalLLMs ?

  29. #Eurollm #europeanai

    mastodon.social/@silentexcepti

    👍

    Is there any initiative to pool the various initiatives across European academia and public research to come up with a common #ecosystem of #europeandata and #LocalLLMs ?

  30. #Eurollm #europeanai

    mastodon.social/@silentexcepti

    👍

    Is there any initiative to pool the various initiatives across European academia and public research to come up with a common #ecosystem of #europeandata and #LocalLLMs ?

  31. #Eurollm #europeanai

    mastodon.social/@silentexcepti

    👍

    Is there any initiative to pool the various initiatives across European academia and public research to come up with a common #ecosystem of #europeandata and #LocalLLMs ?

  32. I spent some time playing around with Local LLMs on Apple Silicon. Here's how that played out.

    Local LLMs on Spare Apple Silicon: A Cautionary Tale
    macadminmusings.com/blog/2026/

  33. I spent some time playing around with Local LLMs on Apple Silicon. Here's how that played out.

    Local LLMs on Spare Apple Silicon: A Cautionary Tale
    macadminmusings.com/blog/2026/
    #MacAdmins #LocalLLMs

  34. I spent some time playing around with Local LLMs on Apple Silicon. Here's how that played out.

    Local LLMs on Spare Apple Silicon: A Cautionary Tale
    macadminmusings.com/blog/2026/
    #MacAdmins #LocalLLMs