#local-models — Public Fediverse posts

Qwen's 8B and 27B models now run locally on consumer hardware, but the decision to self-host versus use APIs hinges on memory costs, routing logic, and acceptance testing—not just raw capability. A working example: vision tasks and agent loops on the 27B, routine requests on the 8B. https://www.implicator.ai/qwens-8b-and-27b-models-make-local-routing-practical/ #AI #LocalModels #MLOps

No, local models will not win - Sean Goedecke www.seangoedecke.com/local-models-w… #AI #LocalModels (hmm, some interesting ideas)

Building a local AI storyteller - what I learned when prompts were not enough
A blog by Justus

I wanted to understand what happens when you stop treating an LLM as a chatbot and start treating it as a component in a software system. So I built a local AI storyteller using a local LLM through an OpenAI-compatible API.

#dev #softwaredevelopment #java #ai #llm #localmodels #gemma #qwen #softwarearchitecture

https://jdriven.com/blog/2026/07/llm-storyteller/

How The Spread Of Local AI Models Makes Copyright Enforcement Harder

https://fed.brid.gy/r/https://www.techdirt.com/2026/07/14/how-the-spread-of-local-ai-models-makes-copyright-enforcement-harder/

Viability of #localmodels for coding

https://martinfowler.com/articles/exploring-gen-ai/local-models-for-coding-factors.html

#LLM #local

The central theme of Walled Culture the book (free digital versions available) is the growing incompatibility between traditional copyright law and the digital, online world. The culmination of that process was the EU Copyright Directive, passed in 2019. The Directive was supposed to be transposed into local laws by 2021, but a year after that deadline, many EU member states had failed to do […]

Oh, look, another techie bragging about their overpowered Mac and their obsession with running local models that no one asked for 😂. Apparently, 2026 is the year when local models finally got "good," or maybe it's just another excuse to flex their RAM 💪. Who knew spending a fortune on hardware could make old tech "surprisingly good"? 🙄
https://vickiboykis.com/2026/06/15/running-local-models-is-good-now/ #techbragging #localmodels #overpricedhardware #flexingRAM #2026tech #HackerNews #ngated

Wow, 13 minutes of your life you'll never get back, all to discover that you can run local models on an #M4 with a whopping #24GB of memory! 🥳 Next, maybe they'll tell us water is wet. 💧 So thrilling!
https://jola.dev/posts/running-local-models-on-m4 #localmodels #memory #technews #thrilling #discoveries #HN #HackerNews #ngated

Running local models on an M4 with 24GB memory

https://jola.dev/posts/running-local-models-on-m4

#HackerNews #localmodels #M4 #24GBmemory #machinelearning #AIdevelopment #techtrends

via #AIFoundry : AI-Assisted Development powered by Local Models

https://ift.tt/gsWHLrh
#AI #LocalModels #Privacy #Development #GitHubCopilot #VisualStudioCode #FoundryLocal #AIToolkit #DataPrivacy #Coding #ModelManagement #TechInnovation #SoftwareDevelopment #Productivity #M…

via @dotnet : Local AI + .NET = AltText Magic in One C# Script

https://ift.tt/iFfJ2Gm
#AI #DotNet #AltText #CSharp #Accessibility #LocalModels #Ollama #ImageProcessing #Automation #GenerativeAI #MachineLearning #DevTools #TechForGood #SEO #UX #Coding #Programmin…

@Catvalente

Or just use you AI locally 🦾 💻 🧠

I completely understand the concerns about relying too heavily on AI, especially cloud-based, centralized models like ChatGPT. The issues of privacy, energy consumption, and the potential for misuse are very real and valid. However, I believe there's a middle ground that allows us to benefit from the advantages of AI without compromising our values or autonomy.

Instead of rejecting AI outright, we can opt for open-source models that run on local hardware. I've been using local language models (LLMs) on my own hardware. This approach offers several benefits:

- Privacy - By running models locally, we can ensure that our data stays within our control and isn't sent to third-party servers.

- Transparency - Open-source models allow us to understand how the AI works, making it easier to identify and correct biases or errors.

- Customization - Local models can be tailored to our specific needs, whether it's for accessibility, learning, or creative projects.

- Energy Efficiency - Local processing can be more energy-efficient than relying on large, centralized data centers.

- Empowerment - Using AI as a tool to augment our own abilities, rather than replacing them, can help us learn and grow. It's about leveraging technology to enhance our human potential, not diminish it.

For example, I use local LLMs for tasks like proofreading, transcribing audio, and even generating image descriptions. Instead of ChatGPT and Grok, I utilize Jan.ai with Mistral, Llama, OpenCoder, Qwen3, R1, WhisperAI, and Piper. These tools help me be more productive and creative, but they don't replace my own thinking or decision-making.

It's also crucial to advocate for policies and practices that ensure AI is used ethically and responsibly. This includes pushing back against government overreach and corporate misuse, as well as supporting initiatives that promote open-source and accessible technologies.

In conclusion, while it's important to be critical of AI and its potential downsides, I believe that a balanced, thoughtful approach can allow us to harness its benefits without sacrificing our values. Let's choose to be informed, engaged, and proactive in shaping the future of AI.

CC: @Catvalente @audubonballroon
@calsnoboarder @craigduncan

#ArtificialIntelligence #OpenSource #LocalModels #PrivacyLLM #Customization #LocalAI #Empowerment #DigitalLiteracy #CriticalThinking #EthicalAI #ResponsibleAI #Accessibility #Inclusion #Education