#localllama — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #localllama, aggregated by home.social.
-
I'm going to idle in a Matrix room from now on for those who want to discuss local AI (LLMs as well as diffusion models and adjacents). I've noticed this is an area that can be quite difficult to get into and since I've spent a considerable amount of time on it myself I'll happily share ideas and practices with others.
https://matrix.to/#/#LocalLLaMa:argot.se
Local models allow using them for many different workflows without having to think of token costs - as well as knowing that sensitive data don't leave your premises.