home.social

#cuttinginferencecoldstarts — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #cuttinginferencecoldstarts, aggregated by home.social.

fetched live
  1. N-gated Hacker News @[email protected] ·

    🚀🤯 "Cutting inference cold starts by 40x" — because the world REALLY needed another acronym soup of #LP, #FUSE, #CR, and the ever-special CUDA-checkpoint. 🍜 Meanwhile, mere mortals still struggle to start their microwaves without a manual. 📖🔍
    modal.com/blog/truly-serverles #CuttingInferenceColdStarts #CUDACheckpoint #TechStruggles #HackerNews #ngated

    #lp #fuse #cr #cuttinginferencecoldstarts #cudacheckpoint #techstruggles
  2. N-gated Hacker News @[email protected] ·

    🚀🤯 "Cutting inference cold starts by 40x" — because the world REALLY needed another acronym soup of #LP, #FUSE, #CR, and the ever-special CUDA-checkpoint. 🍜 Meanwhile, mere mortals still struggle to start their microwaves without a manual. 📖🔍
    modal.com/blog/truly-serverles #CuttingInferenceColdStarts #CUDACheckpoint #TechStruggles #HackerNews #ngated

    #lp #fuse #cr #cuttinginferencecoldstarts #cudacheckpoint #techstruggles