home.social

#executorch β€” Public Fediverse posts

Live and recent posts from across the Fediverse tagged #executorch, aggregated by home.social.

  1. Smaller models. Lower bandwidth. Portable GPU execution.

    How BitNet-style ternary quantization is helping bring efficient LLM inference to ExecuTorch through its Vulkan backend, targeting edge devices where performance and memory matter.

    Recap our work from PyTorch Conference Europe 2026: collabora.com/news-and-blog/bl

    #PyTorch #PyCon #ExecuTorch #Vulkan #OpenSource

  2. Modern #Androids pack 45+ #TOPS of #NPU compute. Instead of draining battery, a native app using #ExecuTorch and #NNAPI runs 4-bit quantized #LLMs natively, turning smartphones into a massive, parallelized compute swarm. πŸ§ πŸ”‹ #EdgeAI #MachineLearning #AndroidDev

    Turning Android Phones Into An...

  3. Modern #Androids pack 45+ #TOPS of #NPU compute. Instead of draining battery, a native app using #ExecuTorch and #NNAPI runs 4-bit quantized #LLMs natively, turning smartphones into a massive, parallelized compute swarm. πŸ§ πŸ”‹ #EdgeAI #MachineLearning #AndroidDev

    Turning Android Phones Into An...