#4xfasterinference — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #4xfasterinference, aggregated by home.social.
-
4x faster LLM inference (Flash Attention guy's company)
https://www.together.ai/blog/adaptive-learning-speculator-system-atlas
#HackerNews #4xFasterInference #FlashAttention #LLMTechnology #AIInnovation #AdaptiveLearning