#osaurus — Public Fediverse posts

I'm currently testing a few #LLM #MLX runtimes/apps on my #M5 Pro 24 GB. So far, I can't say which one gets the best performance out of a local LLM like #Gemma 4 12B.
I've tested #Ollama, #LMStudio, #oMlx, and #osaurus. Each one has its own 1-2 tweaks that are supposed to squeeze out more performance.

What's your experience been like?

#Apple #MacBook #AI #localai #localllm

Osaurus trae modelos de IA locales y en la aglomeración a tu Mac #ai #AI_local #aplicaciones_mac #Locales #Mac #Modelos #nube #osaurus #trae #ButterWord #Spanish_News Comenta tu opinión 👇
https://butterword.com/osaurus-trae-modelos-de-ia-locales-y-en-la-aglomeracion-a-tu-mac/?feed_id=81358&_unique_id=6a07188531afe