#hbm4 — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #hbm4, aggregated by home.social.
-
Samsung, SK Chiefs Head to New York to Deepen Nvidia Ties
Samsung Electronics Chairman Lee Jae-yong (from left), Nvidia CEO Jensen Huang and SK Chairman Chey Tae-won talk during…
#EuropeSays #Korea #KR #SK #HBM4 #JensenHuang #NVIDIA #SamsungElectronics #SKGroup #SKhynix #VanFleetAward #VeraRubin
https://www.europesays.com/korea/142569/ -
#Nvidia and #SKGroup announced a $500 billion #AIinitiative, including a #partnership with #SKHynix for next-generation memory and a 2-gigawatt AI data centre powered by Nvidia’s #VeraRubin #chips and SK Hynix’s #HBM4 #memory. https://www.reuters.com/business/media-telecom/nvidia-sk-group-unveil-500-billion-plus-ai-data-centers-initiative-memory-2026-07-24/?AIagents.at #AIagent #AI #ML #NLP #LLM #GenAI
-
Dentro la gerarchia della memoria delle GPU: come i server AI spostano i dati dagli SSD alla HBM
Ti sei mai chiesto come i modelli di intelligenza artificiale trasferiscono i dati alla GPU? Questo articolo spiega in modo semplice i diversi livelli di memoria all'interno di un server AI, perché la memoria della GPU è diventata un collo di bottiglia e quali nuove tecnologie potrebbero migliorare le prestazioni dell'intelligenza artificiale.
buysellram.com/blog/inside-the…
#HBM #HBM4 #GPUMemory #AIInfrastructure #DataCenter #CXL #HighBandwidthFlash #AIHardware #MemoryHierarchy #AIInference #NVMe #ITAD
-
Why can't a GPU just carry more HBM? Interposers max out in size, stacking 12 to 16 DRAM dies compounds yield losses, and every stack sits beside a kilowatt-class package that hates sharing heat. So capacity climbs in careful steps — 80 GB on the H100, 141 on the H200, 192 on the B200, 288 on Blackwell Ultra — while KV caches for long-context inference balloon past 40 GB per request.
That gap between what models demand and what packaging permits is reshaping server design. NVIDIA's Rubin platform treats CPU memory and HBM as one coherent pool. SanDisk and SK hynix are standardizing High Bandwidth Flash as a capacity tier under HBM, with first samples due this half. CXL 4.0 pooling hardware is landing in racks now.
This article walks the whole memory hierarchy, from on-chip SRAM to NVMe, and explains what each emerging technology actually solves — and what it doesn't.
#HBM #HBM4 #GPUMemory #AIInfrastructure #DataCenter #CXL #HighBandwidthFlash #AIHardware #MemoryHierarchy #AIInference #NVMe #ITAD #technology
