#turboquant — Public Fediverse posts

Turbovec – Google's TurboQuant for vector search in Rust

https://github.com/RyanCodrai/turbovec

Comments: https://news.ycombinator.com/item?id=49349898

#HackerNews #Turbovec #Google #TurboQuant #Rust #VectorSearch #OpenSource

#Google's #TurboQuant #algorithm could produce 2–8x smaller #vector indexes in #pgvector for my favorite database #PostgreSQL

https://github.com/pgvector/pgvector/pull/989

Yet the PR and code change are written using #AI and huge, so I am curious how this PR will be handled by the maintainers.

So enough #tags for today :)

🧠 #TurboVec è un indice vettoriale open source costruito sull'algoritmo #TurboQuant sviluppato da #Google Research.

👉 I dettagli: https://www.linkedin.com/posts/alessiopomaro_turbovec-turboquant-google-share-7469634641373585408-NVML/

___ 
✉️ 𝗦𝗲 𝘃𝘂𝗼𝗶 𝗿𝗶𝗺𝗮𝗻𝗲𝗿𝗲 𝗮𝗴𝗴𝗶𝗼𝗿𝗻𝗮𝘁𝗼/𝗮 𝘀𝘂 𝗾𝘂𝗲𝘀𝘁𝗲 𝘁𝗲𝗺𝗮𝘁𝗶𝗰𝗵𝗲, 𝗶𝘀𝗰𝗿𝗶𝘃𝗶𝘁𝗶 𝗮𝗹𝗹𝗮 𝗺𝗶𝗮 𝗻𝗲𝘄𝘀𝗹𝗲𝘁𝘁𝗲𝗿: https://bit.ly/newsletter-alessiopomaro

#AI #GenAI #GenerativeAI #IntelligenzaArtificiale #LLM 

Gemma 4 QAT is here - now I’m waiting for Ollama TurboQuant so the full stack is ready: QAT, MoE, sparse-active models, smarter attention, and MTP speculative decoding. #Gemma4 #Ollama #TurboQuant #QAT #MoE #MTP #LocalAI

RT @coffeecup2020: TurboQuant - Qwopus3.6-27B-v2-TQ34S.gguf

mehr auf Arint.info

#AI #HuggingFace #MachineLearning #OpenSource #Qwopus #TurboQuant #arint_info

https://x.com/coffeecup2020/status/2058117304185999409#m

🧠 Il vero collo di bottiglia dei #LLM moderni non è più il calcolo: è la memoria.
✨ #Google Research, recentemente, ha presentato #TurboQuant. 

👉 Un approfondimento: https://www.linkedin.com/posts/alessiopomaro_turboquant-llm-rag-activity-7462380695353524224-Ek0x

___ 
✉️ 𝗦𝗲 𝘃𝘂𝗼𝗶 𝗿𝗶𝗺𝗮𝗻𝗲𝗿𝗲 𝗮𝗴𝗴𝗶𝗼𝗿𝗻𝗮𝘁𝗼/𝗮 𝘀𝘂 𝗾𝘂𝗲𝘀𝘁𝗲 𝘁𝗲𝗺𝗮𝘁𝗶𝗰𝗵𝗲, 𝗶𝘀𝗰𝗿𝗶𝘃𝗶𝘁𝗶 𝗮𝗹𝗹𝗮 𝗺𝗶𝗮 𝗻𝗲𝘄𝘀𝗹𝗲𝘁𝘁𝗲𝗿: https://bit.ly/newsletter-alessiopomaro

#AI #GenAI #GenerativeAI #IntelligenzaArtificiale #LLM 

TurboQuant Sessiz Çökme Sorunu ve OpenSSL 3 Çözümü

Yerel yapay zeka modellerinde 128K gibi devasa context pencerelerine yelken açmak isterken llama-server.exe'nin hiçbir hata vermeden anında kapanmasıyla karşılaştım. TheTom/llama-cpp-turboquant Windows CUDA 12.4 paketinde unutulan OpenSSL DLL'lerini (STATUS_DLL_NOT_FOUND) ve winget ile LTS sürümünü kurarak bu can sıkıcı problemi kendi sistemimde nasıl çözdüğümü anlattım.

https://yuceltoluyag.github.io/turboquant-sessiz-cokme-cozumu/

#ai #llamacpp #turboquant #openssl #windows

🧠 Il vero cambiamento non è che #Google capirà meglio una pagina. È che potrà valutarne molte di più.
✨ #TurboQuant, il nuovo sistema di cui sta parlando la community #SEO, va letto in questa direzione.

👉 Un approfondimento: https://www.linkedin.com/posts/alessiopomaro_google-turboquant-seo-activity-7461292556304306176-SHvi

___ 
✉️ 𝗦𝗲 𝘃𝘂𝗼𝗶 𝗿𝗶𝗺𝗮𝗻𝗲𝗿𝗲 𝗮𝗴𝗴𝗶𝗼𝗿𝗻𝗮𝘁𝗼/𝗮 𝘀𝘂 𝗾𝘂𝗲𝘀𝘁𝗲 𝘁𝗲𝗺𝗮𝘁𝗶𝗰𝗵𝗲, 𝗶𝘀𝗰𝗿𝗶𝘃𝗶𝘁𝗶 𝗮𝗹𝗹𝗮 𝗺𝗶𝗮 𝗻𝗲𝘄𝘀𝗹𝗲𝘁𝘁𝗲𝗿: https://bit.ly/newsletter-alessiopomaro

#AI #GenAI #GenerativeAI #IntelligenzaArtificiale #LLM #SEO

Impressive:

“TurboQuant: Redefining AI Efficiency With Extreme Compression”, Amir Zandieh, et al, Google Research (https://research.google/blog/turboquant-redefining-ai-efficiency-with-extreme-compression/).

The paper: https://arxiv.org/abs/2504.19874

On HN: https://news.ycombinator.com/item?id=47513475

#TurboQuant #Quantization #LLMs #Vectors #Compression #Paper

Революция на рынке ОЗУ откладывается. Праотец TurboQuant раскрыл все нюансы и написал жалобу в комитет по этике

Инженеры Google пообещали сократить потребление памяти в 8 раз. Рынок ОЗУ тут же отреагировал: акции покатались вниз. Финансовые аналитики, как и всё ИИ-сообщество в те дни, не учли несколько технических нюансов.

https://habr.com/ru/companies/tsnis/articles/1028924/

#искусственный_интеллект #нейросети #озу #google #turboquant #кризис

TurboQuant: where #buzzwords meet #browser 💥! Dive into a dizzying labyrinth of interactive charts and jargon, all promising to compress your brain into 24 bits without losing accuracy. Perfect for those who enjoy feeling inadequate while their CPU tries to decode yet another gratuitous acronym 🤯.
https://arkaung.github.io/interactive-turboquant/ #TurboQuant #InteractiveCharts #TechJargon #CPUChallenge #HackerNews #ngated

TurboQuant: A First-Principles Walkthrough

https://arkaung.github.io/interactive-turboquant/

#HackerNews #TurboQuant #FirstPrinciples #Walkthrough #MachineLearning #DataScience #TechInnovation

KV Cache Compression 900000x Beyond TurboQuant and Per-Vector Shannon Limit

https://arxiv.org/abs/2604.15356

#HackerNews #KVCache #Compression #TurboQuant #ShannonLimit #DataCompression

TurboQuant model weight compression now graces #Llamacpp, but only if you speak fluent Metal! 🏋️‍♂️ Meanwhile, everyone else waits for TheTom to bless us with a #CUDA port, assuming he ever emerges from the GitHub labyrinth of Pull Request 45. How many engineers does it take to compress a llama? 🤔
https://github.com/TheTom/llama-cpp-turboquant/pull/45 #TurboQuant #Metal #PullRequest #HackerNews #ngated

TurboQuant model weight compression support added to Llamacpp

https://github.com/TheTom/llama-cpp-turboquant/pull/45

#HackerNews #TurboQuant #Llamacpp #model #weight #compression #AI #optimization #machinelearning

In today's episode of "Let's Pretend We Understand Tech Jargon," we have #TurboQuant claiming to turn your vector search into a 2-4 bit compression masterpiece #🤖✨. Because compressing data is sooo easy, right? Just sprinkle some GitHub Copilot fairy dust and voilà! Magic! 🪄🙄
https://github.com/RyanCodrai/py-turboquant #TechJargon #DataCompression #GitHubCopilot #InnovationMagic #HackerNews #ngated

TurboQuant for vector search – 2-4 bit compression

https://github.com/RyanCodrai/py-turboquant

#HackerNews #TurboQuant #Vector #Search #Compression #Technology #2-4 #Bit #Compression #GitHub #Project

TurboQuant KV Compression and SSD Expert Streaming for M5 Pro and IOS

https://github.com/SharpAI/SwiftLM

#HackerNews #TurboQuant #KV #Compression #SSD #Expert #Streaming #M5Pro #iOS

#KI #AI bekommt einen Algorithmischen Entwicklungsschub in seiner Quantisierung rein Software basiert;) #turboQuant

https://youtu.be/7YVrb3-ABYE?is=YmGtkMmrEwA1_v87

https://arxiv.org/pdf/2504.19874

Google's TurboQuant just changed the AI game. 🪈

→ 6x KV cache memory compression
→ 8x faster attention on H100 GPUs
→ Zero accuracy loss
→ No retraining needed

The AI world is calling it the real-life Pied Piper — and honestly, the comparison holds up.

Full breakdown here 👇
🔗 https://www.techx.press/ai/google-turboquant/

#TurboQuant #GoogleAI #LLM #AIInference #MachineLearning

The key takeaway isn’t just compression—it’s where the bottleneck shifts. KV cache has been dominating memory footprint in long-context inference, so reducing it changes the cost structure significantly. But it doesn’t remove the constraint entirely.

https://www.buysellram.com/blog/will-googles-turboquant-ai-compression-finally-demolish-the-ai-memory-wall/

#AI #ArtificialIntelligence #TurboQuant #Google #AIMemoryWall #AICompression #KVCache #LLMInference #AIInfrastructure #MemoryBottleneck #ModelEfficiency #AIHardware #DataCenter

The key takeaway isn’t just compression—it’s where the bottleneck shifts. KV cache has been dominating memory footprint in long-context inference, so reducing it changes the cost structure significantly. But it doesn’t remove the constraint entirely:
https://www.buysellram.com/blog/will-googles-turboquant-ai-compression-finally-demolish-the-ai-memory-wall/

#AI #ArtificialIntelligence #TurboQuant #Google #AIMemoryWall #AICompression #KVCache #LLMInference #AIInfrastructure #MemoryBottleneck #ModelEfficiency #AIHardware #DataCenter #technology

The AI world is buzzing over TurboQuant, Google Research’s new answer to the AI Memory Wall. This isn't just an incremental update; it’s a fundamental shift in how we think about hardware efficiency.

By combining two new methods—PolarQuant and QJL—Google has managed to compress the Key-Value (KV) cache by 6x with zero accuracy loss. For those running H100s, this translates to an 8x speedup in attention processing.

Why it matters:

Beyond Brute Force: Much like DeepSeek-R1, Google is proving that high-level math can bypass the need for endless HBM expansion.

The "Memory Wall" Pivot: TurboQuant moves the bottleneck from memory bandwidth to compute, effectively "stretching" the life of existing silicon.

The Jevons Paradox: History shows that when we make a resource (memory) 6x more efficient, we don't use less of it—we build models 10x larger.

Is this the end of the global DRAM shortage, or just the beginning of a much larger scaling era?

https://www.buysellram.com/blog/will-googles-turboquant-ai-compression-finally-demolish-the-ai-memory-wall/

#AI #ArtificialIntelligence #TurboQuant #Google #AIMemoryWall #AICompression #KVCache #LLMInference #AIInfrastructure #MemoryBottleneck #ModelEfficiency #AIHardware #DataCenter #deepseek #technology

Google’s TurboQuant is being positioned as a breakthrough that could finally break the AI “memory wall”—but the reality is more nuanced.

In this analysis, we explore how TurboQuant achieves up to 6× memory reduction and 8× performance gains by compressing KV cache during inference, enabling more efficient use of existing GPUs like A100 and H100.

The upside is clear: lower infrastructure costs, extended hardware lifecycles, and the potential to run long-context AI workloads on more affordable systems. However, compression is not a silver bullet. The compute overhead of decompression, the persistent weight memory requirements, and the long-term effects of the Jevons Paradox suggest that demand for high-performance hardware is far from over.

https://www.buysellram.com/blog/will-googles-turboquant-ai-compression-finally-demolish-the-ai-memory-wall/

#AI #ArtificialIntelligence #TurboQuant #Google #AIMemoryWall #AICompression #KVCache #LLMInference #AIInfrastructure #MemoryBottleneck #ModelEfficiency #AIHardware #DataCenter #tech

Google’s TurboQuant is being positioned as a breakthrough that could finally break the AI “memory wall”—but the reality is more nuanced.
In this analysis, we explore how TurboQuant achieves up to 6× memory reduction and 8× performance gains by compressing KV cache during inference, enabling more efficient use of existing GPUs like A100 and H100.
https://www.buysellram.com/blog/will-googles-turboquant-ai-compression-finally-demolish-the-ai-memory-wall/

#AI #TurboQuant #Google #AIMemoryWall #AICompression #KVCache #ModelEfficiency #AIHardware #DataCenter #technology

Google's TurboQuant Compresses AI Memory by 6x — With Zero Accuracy Loss

https://techlife.blog/posts/google-turboquant

#Google #TurboQuant #LLM #AIEfficiency #KVCache #ICLR2026 #MachineLearning #Compression