#omlx — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #omlx, aggregated by home.social.
-
I'm currently testing a few #LLM #MLX runtimes/apps on my #M5 Pro 24 GB. So far, I can't say which one gets the best performance out of a local LLM like #Gemma 4 12B.
I've tested #Ollama, #LMStudio, #oMlx, and #osaurus. Each one has its own 1-2 tweaks that are supposed to squeeze out more performance.What's your experience been like?
-
I'm currently testing a few #LLM #MLX runtimes/apps on my #M5 Pro 24 GB. So far, I can't say which one gets the best performance out of a local LLM like #Gemma 4 12B.
I've tested #Ollama, #LMStudio, #oMlx, and #osaurus. Each one has its own 1-2 tweaks that are supposed to squeeze out more performance.What's your experience been like?
-
#oMLX schaut genau nach der richtigen mischung zwischen #ollama - wo man zu wenig einstellen kann - und #lmstudio - wo man zu viel einstellen kann :-P
sehr aufgeräumtes design und guter erst eindruck - pinguin als logo vllt ein bissel zu selbstbewusst :D
ich hab das bisher so gelöst: lmstudio hört auf 0.0.0.0 - #macstudio ist mit #tailscale verbunden mit vserver - caddy auf vserver stellt mein lmstudio über https in netz
so kann ich von überall meinen lokaken llm aufrufen
ist dann noch #localai ??? wohl eher #selfhostedAI :)
-
Hermes Agent + oMLX = Caching-aware agent harness on macOS
Claude Code’s source code leak revealed a huge gap in context management and cache-awareness comparing to its open-source alternatives like OpenCode.
Hermes Agent is doing a better job at these among the “claws” ATM.
https://hermes-agent.nousresearch.com
-
Hermes Agent + oMLX = Caching-aware agent harness on macOS
Claude Code’s source code leak revealed a huge gap in context management and cache-awareness comparing to its open-source alternatives like OpenCode.
Hermes Agent is doing a better job at these among the “claws” ATM.
https://hermes-agent.nousresearch.com
-
Finally, an open-source alternative that's easy to use and performs better than #LMStudio on Mac with support for MLX!
A bit shady that it uploads the benchmark result without noticing or asking tho
-
#OpenMandrivaROME 24.07 has been released (#OpenMandrivaLxROME / #RollingReleaseDistribution / #RollingReleaseLinux / #OpenMandrivaLx / #OMLx / #OpenMandriva / #MandrivaLinux / #Mandriva / #MandrakeLinux / #Linux) https://www.openmandriva.org/
-
#OpenMandrivaROME 24.07 has been released (#OpenMandrivaLxROME / #RollingReleaseDistribution / #RollingReleaseLinux / #OpenMandrivaLx / #OMLx / #OpenMandriva / #MandrivaLinux / #Mandriva / #MandrakeLinux / #Linux) https://www.openmandriva.org/
-
#OpenMandrivaROME 24.07 RC has been released (#OpenMandrivaLxROME / #RollingReleaseDistribution / #RollingReleaseLinux / #OpenMandrivaLx / #OMLx / #OpenMandriva / #MandrivaLinux / #Mandriva / #MandrakeLinux / #Linux) https://www.openmandriva.org/
-
#OpenMandrivaROME 24.07 RC has been released (#OpenMandrivaLxROME / #RollingReleaseDistribution / #RollingReleaseLinux / #OpenMandrivaLx / #OMLx / #OpenMandriva / #MandrivaLinux / #Mandriva / #MandrakeLinux / #Linux) https://www.openmandriva.org/