#cxl — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #cxl, aggregated by home.social.
-
Samsung, SK Hynix Race to Mass-Produce CXL 3.2 Memory This Year, Ushering in the ‘Next Memory’ Era — BigGo Finance
Samsung Electronics (005930) and SK Hynix (000660) are transitioning to mass production this year to seize the initiative…
#EuropeSays #Korea #KR #SKHynix #AImemory #CMM-D3.0 #CXL #CXL3.2 #GoldmanSachs #HBM #Micron #NVIDIA #SamsungElectronics #SK #SKhynix
https://www.europesays.com/korea/91164/ -
RAM has always been trapped inside the server it shipped in — one machine's shortage next to another's idle gigabytes. SK hynix now says memory could be sold as a subscription instead. This explainer covers the technology that would carry it: CXL, memory appliances, rack-level switches, and tiering — plus Meta's production proof that pooled thinking already pays, right down to reused DDR4.
https://www.buysellram.com/blog/memory-as-a-service-cxl/
#MemoryAsAService #CXL #DRAM #DataCenter #AIInfrastructure #SKhynix #MemoryPooling -
RAM has always been trapped inside the server it shipped in — one machine's shortage next to another's idle gigabytes. SK hynix now says memory could be sold as a subscription instead. This explainer covers the technology that would carry it: CXL, memory appliances, rack-level switches, and tiering — plus Meta's production proof that pooled thinking already pays, right down to reused DDR4.
https://www.buysellram.com/blog/memory-as-a-service-cxl/
#MemoryAsAService #CXL #DataCenter #AIInfrastructure #DRAM #Semiconductors
-
SK hynix's parent group says it may offer "Memory as a Service" — RAM capacity sold like a cloud subscription rather than a chip in a box. The idea is early, but the hardware underneath it is not.
This explainer walks through the full stack: why memory gets stranded inside servers, how CXL adds the cache coherency that PCIe never had, what memory appliances and CXL 3.0 switches actually do, and why tiering keeps local DRAM first. It also draws a line many articles blur — memory expansion (which Meta already runs across millions of servers, reusing retired DDR4) versus rack-level pooling, which is only now reaching real silicon.
The business angle matters too: subscriptions would smooth the boom-and-bust cycle memory makers have never escaped. And for everyone else, the takeaway is simpler — memory is becoming an asset with value independent of the server it shipped in.
https://www.buysellram.com/blog/memory-as-a-service-cxl/
#MemoryAsAService #CXL #DRAM #DataCenter #AIInfrastructure #SKhynix #MemoryPooling #DDR4 #ServerHardware #Semiconductors #AIHardware #ITAD #technology -
SK hynix's parent group says it may offer "Memory as a Service" — RAM capacity sold like a cloud subscription rather than a chip in a box. The idea is early, but the hardware underneath it is not.
This explainer walks through the full stack: why memory gets stranded inside servers, how CXL adds the cache coherency that PCIe never had, what memory appliances and CXL 3.0 switches actually do, and why tiering keeps local DRAM first. It also draws a line many articles blur — memory expansion (which Meta already runs across millions of servers, reusing retired DDR4) versus rack-level pooling, which is only now reaching real silicon.
The business angle matters too: subscriptions would smooth the boom-and-bust cycle memory makers have never escaped. And for everyone else, the takeaway is simpler — memory is becoming an asset with value independent of the server it shipped in.
https://www.buysellram.com/blog/memory-as-a-service-cxl/
#MemoryAsAService #CXL #DRAM #DataCenter #AIInfrastructure #SKhynix #MemoryPooling #DDR4 #ServerHardware #Semiconductors #AIHardware #ITAD #technology -
RAM has always been trapped inside the server it shipped in — one machine's shortage next to another's idle gigabytes. SK hynix now says memory could be sold as a subscription instead. This explainer covers the technology that would carry it: CXL, memory appliances, rack-level switches, and tiering — plus Meta's production proof that pooled thinking already pays, right down to reused DDR4.
https://www.buysellram.com/blog/memory-as-a-service-cxl/
#MemoryAsAService #CXL #DataCenter #AIInfrastructure #DRAM #Semiconductors #tech
-
RAM has always been trapped inside the server it shipped in — one machine's shortage next to another's idle gigabytes. SK hynix now says memory could be sold as a subscription instead. This explainer covers the technology that would carry it: CXL, memory appliances, rack-level switches, and tiering — plus Meta's production proof that pooled thinking already pays, right down to reused DDR4.
https://www.buysellram.com/blog/memory-as-a-service-cxl/
#MemoryAsAService #CXL #DataCenter #AIInfrastructure #DRAM #Semiconductors #tech
-
Dentro la gerarchia della memoria delle GPU: come i server AI spostano i dati dagli SSD alla HBM
Ti sei mai chiesto come i modelli di intelligenza artificiale trasferiscono i dati alla GPU? Questo articolo spiega in modo semplice i diversi livelli di memoria all'interno di un server AI, perché la memoria della GPU è diventata un collo di bottiglia e quali nuove tecnologie potrebbero migliorare le prestazioni dell'intelligenza artificiale.
buysellram.com/blog/inside-the…
#HBM #HBM4 #GPUMemory #AIInfrastructure #DataCenter #CXL #HighBandwidthFlash #AIHardware #MemoryHierarchy #AIInference #NVMe #ITAD
-
Dentro la gerarchia della memoria delle GPU: come i server AI spostano i dati dagli SSD alla HBM
Ti sei mai chiesto come i modelli di intelligenza artificiale trasferiscono i dati alla GPU? Questo articolo spiega in modo semplice i diversi livelli di memoria all'interno di un server AI, perché la memoria della GPU è diventata un collo di bottiglia e quali nuove tecnologie potrebbero migliorare le prestazioni dell'intelligenza artificiale.
buysellram.com/blog/inside-the…
#HBM #HBM4 #GPUMemory #AIInfrastructure #DataCenter #CXL #HighBandwidthFlash #AIHardware #MemoryHierarchy #AIInference #NVMe #ITAD
-
A modern AI server runs five layers of memory, from nanosecond on-chip SRAM to petabyte-scale SSDs, and keeping the GPU fed is the whole engineering game. This piece walks the full hierarchy: why HBM became the bottleneck, why adding more isn't simple, and where HBF, CXL, and PIM fit into the next generation.
#HBM #HBM4 #GPUMemory #AIInfrastructure #DataCenter #CXL #HighBandwidthFlash #AIHardware #MemoryHierarchy #AIInference #NVMe #ITAD #buysellram
-
Why can't a GPU just carry more HBM? Interposers max out in size, stacking 12 to 16 DRAM dies compounds yield losses, and every stack sits beside a kilowatt-class package that hates sharing heat. So capacity climbs in careful steps — 80 GB on the H100, 141 on the H200, 192 on the B200, 288 on Blackwell Ultra — while KV caches for long-context inference balloon past 40 GB per request.
That gap between what models demand and what packaging permits is reshaping server design. NVIDIA's Rubin platform treats CPU memory and HBM as one coherent pool. SanDisk and SK hynix are standardizing High Bandwidth Flash as a capacity tier under HBM, with first samples due this half. CXL 4.0 pooling hardware is landing in racks now.
This article walks the whole memory hierarchy, from on-chip SRAM to NVMe, and explains what each emerging technology actually solves — and what it doesn't.
#HBM #HBM4 #GPUMemory #AIInfrastructure #DataCenter #CXL #HighBandwidthFlash #AIHardware #MemoryHierarchy #AIInference #NVMe #ITAD #technology
-
Why can't a GPU just carry more HBM? Interposers max out in size, stacking 12 to 16 DRAM dies compounds yield losses, and every stack sits beside a kilowatt-class package that hates sharing heat. So capacity climbs in careful steps — 80 GB on the H100, 141 on the H200, 192 on the B200, 288 on Blackwell Ultra — while KV caches for long-context inference balloon past 40 GB per request.
That gap between what models demand and what packaging permits is reshaping server design. NVIDIA's Rubin platform treats CPU memory and HBM as one coherent pool. SanDisk and SK hynix are standardizing High Bandwidth Flash as a capacity tier under HBM, with first samples due this half. CXL 4.0 pooling hardware is landing in racks now.
This article walks the whole memory hierarchy, from on-chip SRAM to NVMe, and explains what each emerging technology actually solves — and what it doesn't.
#HBM #HBM4 #GPUMemory #AIInfrastructure #DataCenter #CXL #HighBandwidthFlash #AIHardware #MemoryHierarchy #AIInference #NVMe #ITAD #technology
-
A modern AI server runs five layers of memory, from nanosecond on-chip SRAM to petabyte-scale SSDs, and keeping the GPU fed is the whole engineering game. This piece walks the full hierarchy: why HBM became the bottleneck, why adding more isn't simple, and where HBF, CXL, and PIM fit into the next generation.
#HBM #HBM4 #GPUMemory #AIInfrastructure #DataCenter #CXL #HighBandwidthFlash #AIHardware #MemoryHierarchy #AIInference #NVMe #tech
-
A modern AI server runs five layers of memory, from nanosecond on-chip SRAM to petabyte-scale SSDs, and keeping the GPU fed is the whole engineering game. This piece walks the full hierarchy: why HBM became the bottleneck, why adding more isn't simple, and where HBF, CXL, and PIM fit into the next generation.
#HBM #HBM4 #GPUMemory #AIInfrastructure #DataCenter #CXL #HighBandwidthFlash #AIHardware #MemoryHierarchy #AIInference #NVMe #tech
-
Иллюзия памяти: как индустрия десятилетиями маскировала ограничения железа
Сейчас память можно увеличить ползунком, Redis поднять одной командой, а состояние сервера оценить по строке в панели управления. Но за этим удобством стоит история компромиссов — сначала инженерам пришлось научить компьютеры работать так, будто памяти больше, чем есть на самом деле, потом диски собрали в массивы, горячие данные перенесли в Redis, а всю эту сложность спрятали за хостингом и managed-сервисами. Индустрия десятилетиями строила убедительные иллюзии поверх ограниченной физической реальности, но почему-то памяти до сих пор недостаточно. Как? Разобрал в статье. Читать
https://habr.com/ru/companies/ruvds/articles/1033394/
#память #виртуальная_память #RAID #Redis #latency #distributed_systems #HBM #CXL #кэширование #ruvds_статьи
-
Что нового слышно о шине CXL: заметки с саммита по вычислениям, памяти и хранению данных
Приветствую, на связи снова Сергей Баширов, ведущий разработчик из R&D-команды Cloud.ru. Недавно я посетил очередной Compute, Memory, and Storage Summit , на котором было довольно много докладов на тему Compute Express Link (CXL). В статье сделал краткую выжимку из выступлений, а также поделился своими наблюдениями и выводами. Рассказал, чем полезна CXL и как устроена эта технология, разобрал сценарии применения в облачной инфраструктуре, а также поделился ссылками на интересные доклады по теме. Читать дальше
https://habr.com/ru/companies/cloud_ru/articles/845946/
#cxl #pci_express #когерентность #суперкомпьютеры #CXL_в_облаке #rdma #compute_express_link #память #gocloud_tech
-
Just Posted: Tom Hollingsworth reports on NVIDIA's GTC event, highlighting the launch of their Blackwell architecture which offers formidable processing power for accelerated AI inferencing and advanced GPU clustering. @networkingnerd #ADFD1 #AI #CHIPSAct #Copilot #CXL #EFD3 #GenAI #MFD11 #Networking #NVIDIABlackwell #NVIDIAGTC #PCIe #Rundown #Security #XFD11
https://gestaltit.com/rundown/tom/nvidia-gtc-news-and-nvidia-blackwell-systems-gestalt-it-rundown-march-20-2024/ -
#SC23 #HPC last year I did some analyst work and made some predictions after #SC22 and I checked in to see how things have developed in this space over the last year. #UCIe #PCI7 #CXL https://insidehpc.com/2023/11/sc23-top500-trends-the-ai-hpc-crossover-chiplet-standardization-the-emergence-of-ucie-and-cxl-advancements/ - also available as a podcast https://mast.hpc.social/@Shahin/111501158135898438
-
#SC23 #HPC last year I did some analyst work and made some predictions after #SC22 and I checked in to see how things have developed in this space over the last year. #UCIe #PCI7 #CXL https://insidehpc.com/2023/11/sc23-top500-trends-the-ai-hpc-crossover-chiplet-standardization-the-emergence-of-ucie-and-cxl-advancements/ - also available as a podcast https://mast.hpc.social/@Shahin/111501158135898438
-
#SC23 #HPC last year I did some analyst work and made some predictions after #SC22 and I checked in to see how things have developed in this space over the last year. #UCIe #PCI7 #CXL https://insidehpc.com/2023/11/sc23-top500-trends-the-ai-hpc-crossover-chiplet-standardization-the-emergence-of-ucie-and-cxl-advancements/ - also available as a podcast https://mast.hpc.social/@Shahin/111501158135898438
-
#SC23 #HPC last year I did some analyst work and made some predictions after #SC22 and I checked in to see how things have developed in this space over the last year. #UCIe #PCI7 #CXL https://insidehpc.com/2023/11/sc23-top500-trends-the-ai-hpc-crossover-chiplet-standardization-the-emergence-of-ucie-and-cxl-advancements/ - also available as a podcast https://mast.hpc.social/@Shahin/111501158135898438
-
#SC23 #HPC last year I did some analyst work and made some predictions after #SC22 and I checked in to see how things have developed in this space over the last year. #UCIe #PCI7 #CXL https://insidehpc.com/2023/11/sc23-top500-trends-the-ai-hpc-crossover-chiplet-standardization-the-emergence-of-ucie-and-cxl-advancements/ - also available as a podcast https://mast.hpc.social/@Shahin/111501158135898438
-
-
-
-
-
-
Just Posted: In his Gestalt IT article, Tom Hollingsworth discusses key announcements from VMware Explore, including new AI integrations with GenAI and updates to VMware NSX, while also covering industry issues like SUSE going private and India's tech import regulations. @networkingnerd #AI #AWS #CXL #Edge #GenerativeAI #India #Kubernetes #Networking #NSXplus #Private5G #Rundown #tanzu #Terraform #TFDx #VMwareExplore #VMwwareExplore2023
https://gestaltit.com/rundown/tom/announcements-from-vmware-explore-gestalt-it-rundown-august-23-2023/ -
Just Posted: In his Gestalt IT article, Tom Hollingsworth discusses key announcements from VMware Explore, including new AI integrations with GenAI and updates to VMware NSX, while also covering industry issues like SUSE going private and India's tech import regulations. @networkingnerd #AI #AWS #CXL #Edge #GenerativeAI #India #Kubernetes #Networking #NSXplus #Private5G #Rundown #tanzu #Terraform #TFDx #VMwareExplore #VMwwareExplore2023
https://gestaltit.com/rundown/tom/announcements-from-vmware-explore-gestalt-it-rundown-august-23-2023/ -
"The cool thing with pooling is, that it does really scale." Es geht um CXL 3.0 und bis das am Markt ist, wird es noch eine längere Weile dauern. Aber wenn es da ist, werden wilde Hardware-Dinge möglich werden, und darauf bin ich schon sehr gespannt. #cxl #disaggregated
-
"The cool thing with pooling is, that it does really scale." Es geht um CXL 3.0 und bis das am Markt ist, wird es noch eine längere Weile dauern. Aber wenn es da ist, werden wilde Hardware-Dinge möglich werden, und darauf bin ich schon sehr gespannt. #cxl #disaggregated
-
"The cool thing with pooling is, that it does really scale." Es geht um CXL 3.0 und bis das am Markt ist, wird es noch eine längere Weile dauern. Aber wenn es da ist, werden wilde Hardware-Dinge möglich werden, und darauf bin ich schon sehr gespannt. #cxl #disaggregated
-
"The cool thing with pooling is, that it does really scale." Es geht um CXL 3.0 und bis das am Markt ist, wird es noch eine längere Weile dauern. Aber wenn es da ist, werden wilde Hardware-Dinge möglich werden, und darauf bin ich schon sehr gespannt. #cxl #disaggregated
-
"The cool thing with pooling is, that it does really scale." Es geht um CXL 3.0 und bis das am Markt ist, wird es noch eine längere Weile dauern. Aber wenn es da ist, werden wilde Hardware-Dinge möglich werden, und darauf bin ich schon sehr gespannt. #cxl #disaggregated
-
We’re welcoming a special guest on the Tech Field Day #TFD27 delegate panel: Siamak Tavallaei of the #CXLConsortium! He’ll present on #CXL in a few hours.
-
We’re welcoming a special guest on the Tech Field Day #TFD27 delegate panel: Siamak Tavallaei of the #CXLConsortium! He’ll present on #CXL in a few hours.
-
