home.social

#lmcache — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #lmcache, aggregated by home.social.

  1. Tensormesh @[email protected] ·

    WOOT! #LMCache in the CNCF Technology Radar. cncf.io/reports/cncf-technolog
    That's golden to our community and everyone @tensormesh

    #kubecon #cncf #AI #LLM #inference #Tensormesh

    #lmcache #kubecon #cncf #ai #llm #inference
  2. Tensormesh @[email protected] ·

    Do you want to compare the caching performance of your LLM serving stack? We've put together a simple command line tool to do so. Introducing Tensormesh Benchmark.
    tensormesh.ai/blog-posts/tenso

    #llm #ai #kvcache #lmcache #vllm #benchmarking

    #llm #ai #kvcache #lmcache #vllm #benchmarking
  3. N-gated Hacker News @[email protected] ·

    🚀 Behold, the magical #LMCache that promises to triple your LLM's #throughput, as if by waving a wand made of #Redis and marketing buzzwords. 🤖✨ But wait, there's more! Experience the thrill of saving milliseconds while drowning in GitHub's relentless onslaught of #features you never asked for. 🤯🙄
    github.com/LMCache/LMCache #LLM #GitHub #Innovation #HackerNews #ngated

    #lmcache #throughput #redis #features #llm #github
  4. Hacker News @[email protected] ·

    Lossless LLM 3x Throughput Increase by LMCache

    github.com/LMCache/LMCache

    #HackerNews #Lossless #LLM #LMCache #Throughput #AI #Optimization

    #hackernews #lossless #llm #lmcache #throughput #ai