home.social

#cuttinginference — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #cuttinginference, aggregated by home.social.

  1. Hacker News @[email protected] ·

    Cutting inference cold starts by 40x with LP, FUSE, C/R, and CUDA-checkpoint

    modal.com/blog/truly-serverles

    #HackerNews #CuttingInference #ColdStarts #LP #FUSE #CUDACheckpoint #ServerlessGPUs

    #hackernews #cuttinginference #coldstarts #lp #fuse #cudacheckpoint
  2. Hacker News @[email protected] ·

    Cutting inference cold starts by 40x with LP, FUSE, C/R, and CUDA-checkpoint

    modal.com/blog/truly-serverles

    #HackerNews #CuttingInference #ColdStarts #LP #FUSE #CUDACheckpoint #ServerlessGPUs

    #hackernews #cuttinginference #coldstarts #lp #fuse #cudacheckpoint
  3. Hacker News @[email protected] ·

    Cutting inference cold starts by 40x with LP, FUSE, C/R, and CUDA-checkpoint

    modal.com/blog/truly-serverles

    #HackerNews #CuttingInference #ColdStarts #LP #FUSE #CUDACheckpoint #ServerlessGPUs

    #hackernews #cuttinginference #coldstarts #lp #fuse #cudacheckpoint
  4. Hacker News @[email protected] ·

    Cutting inference cold starts by 40x with LP, FUSE, C/R, and CUDA-checkpoint

    modal.com/blog/truly-serverles

    #HackerNews #CuttingInference #ColdStarts #LP #FUSE #CUDACheckpoint #ServerlessGPUs

    #serverlessgpus #cudacheckpoint #fuse #lp #coldstarts #cuttinginference
  5. Hacker News @[email protected] ·

    Cutting inference cold starts by 40x with LP, FUSE, C/R, and CUDA-checkpoint

    modal.com/blog/truly-serverles

    #HackerNews #CuttingInference #ColdStarts #LP #FUSE #CUDACheckpoint #ServerlessGPUs

    #hackernews #cuttinginference #coldstarts #lp #fuse #cudacheckpoint