#memorypooling — Public Fediverse posts

Meta measures 43.7% of its servers as memory-capacity bound. They run out of RAM before they run out of cores, network, or storage.

CXL is the standard meant to fix that, and it is further along than most coverage suggests in one direction and further behind in another. Expansion runs in production today. Pooling works on real hardware.

#CXL #ComputeExpressLink #MemoryPooling #ServerMemory #DataCenter #Interconnect #DRAM #DDR4 #DDR5 #AIInfrastructure #tech

https://www.buysellram.com/blog/cxl-memory-explained-can-servers-finally-share-ram/

Most CXL coverage collapses three separate things into one, which is why the technology reads as both imminent and permanently delayed.

Expansion gives a single host extra CXL-attached memory as a second tier. It is in production at hyperscale — 768 GB of local DDR5-6400 alongside 256 GB of reclaimed DDR4-2400 per node, at 0.13 the cost per gigabyte of local DRAM, because those DIMMs were already bought.

Pooling gives several hosts exclusive slices of a shared device, and does not require a switch: a multi-port device pools across whatever hosts plug into it. NSDI '26 measurements put multi-port paths at 260–300 ns against 490–600 ns switched.

Sharing — many hosts on one region, coherent in hardware — is defined in CXL 3.0 and absent from shipping devices.

The economics are the open question. Google researchers put switched break-even around 24 nodes. The same NSDI work finds sparse multi-port topologies save 3% to 5.4%. Topology decides.

#CXL #ComputeExpressLink #MemoryPooling #ServerMemory #DataCenter #Disaggregation #Interconnect #DRAM #DDR4 #DDR5 #AIInfrastructure

https://www.buysellram.com/blog/cxl-memory-explained-can-servers-finally-share-ram/

Most CXL coverage collapses three separate things into one, which is why the technology reads as both imminent and permanently delayed.

Expansion gives a single host extra CXL-attached memory as a second tier. It is in production at hyperscale — 768 GB of local DDR5-6400 alongside 256 GB of reclaimed DDR4-2400 per node, at 0.13 the cost per gigabyte of local DRAM, because those DIMMs were already bought.

Pooling gives several hosts exclusive slices of a shared device, and does not require a switch: a multi-port device pools across whatever hosts plug into it. NSDI '26 measurements put multi-port paths at 260–300 ns against 490–600 ns switched.

Sharing — many hosts on one region, coherent in hardware — is defined in CXL 3.0 and absent from shipping devices.

The economics are the open question. Google researchers put switched break-even around 24 nodes. The same NSDI work finds sparse multi-port topologies save 3% to 5.4%. Topology decides.

#CXL #ComputeExpressLink #MemoryPooling #ServerMemory #DataCenter #Disaggregation #Interconnect #DRAM #DDR4 #DDR5 #AIInfrastructure

https://www.buysellram.com/blog/cxl-memory-explained-can-servers-finally-share-ram/

Meta measures 43.7% of its servers as memory-capacity bound. They run out of RAM before they run out of cores, network, or storage.

CXL is the standard meant to fix that, and it is further along than most coverage suggests in one direction and further behind in another. Expansion runs in production today. Pooling works on real hardware.

#CXL #ComputeExpressLink #MemoryPooling #ServerMemory #DataCenter #Interconnect #DRAM #DDR4 #DDR5 #AIInfrastructure #tech

https://www.buysellram.com/blog/cxl-memory-explained-can-servers-finally-share-ram/

Meta measures 43.7% of its servers as memory-capacity bound. They run out of RAM before they run out of cores, network, or storage.

CXL is the standard meant to fix that, and it is further along than most coverage suggests in one direction and further behind in another. Expansion runs in production today. Pooling works on real hardware.

#CXL #ComputeExpressLink #MemoryPooling #ServerMemory #DataCenter #Interconnect #DRAM #DDR4 #DDR5 #AIInfrastructure #tech

https://www.buysellram.com/blog/cxl-memory-explained-can-servers-finally-share-ram/

Meta measures 43.7% of its servers as memory-capacity bound. They run out of RAM before they run out of cores, network, or storage.

CXL is the standard meant to fix that, and it is further along than most coverage suggests in one direction and further behind in another. Expansion runs in production today. Pooling works on real hardware.

#CXL #ComputeExpressLink #MemoryPooling #ServerMemory #DataCenter #Interconnect #DRAM #DDR4 #DDR5 #AIInfrastructure #tech

https://www.buysellram.com/blog/cxl-memory-explained-can-servers-finally-share-ram/

Meta measures 43.7% of its servers as memory-capacity bound. They run out of RAM before they run out of cores, network, or storage.

CXL is the standard meant to fix that, and it is further along than most coverage suggests in one direction and further behind in another. Expansion runs in production today. Pooling works on real hardware.

#CXL #ComputeExpressLink #MemoryPooling #ServerMemory #DataCenter #Interconnect #DRAM #DDR4 #DDR5 #AIInfrastructure #tech

https://www.buysellram.com/blog/cxl-memory-explained-can-servers-finally-share-ram/

Meta measures 43.7% of its servers as memory-capacity bound. They run out of RAM before they run out of cores, network, or storage.

CXL is the standard meant to fix that, and it is further along than most coverage suggests in one direction and further behind in another. Expansion runs in production today. Pooling works on real hardware.

#CXL #ComputeExpressLink #MemoryPooling #ServerMemory #DataCenter #Interconnect #DRAM #DDR4 #DDR5 #AIInfrastructure #tech

https://www.buysellram.com/blog/cxl-memory-explained-can-servers-finally-share-ram/

RAM has always been trapped inside the server it shipped in — one machine's shortage next to another's idle gigabytes. SK hynix now says memory could be sold as a subscription instead. This explainer covers the technology that would carry it: CXL, memory appliances, rack-level switches, and tiering — plus Meta's production proof that pooled thinking already pays, right down to reused DDR4.

https://www.buysellram.com/blog/memory-as-a-service-cxl/
#MemoryAsAService #CXL #DRAM #DataCenter #AIInfrastructure #SKhynix #MemoryPooling

RAM has always been trapped inside the server it shipped in — one machine's shortage next to another's idle gigabytes. SK hynix now says memory could be sold as a subscription instead. This explainer covers the technology that would carry it: CXL, memory appliances, rack-level switches, and tiering — plus Meta's production proof that pooled thinking already pays, right down to reused DDR4.

https://www.buysellram.com/blog/memory-as-a-service-cxl/
#MemoryAsAService #CXL #DRAM #DataCenter #AIInfrastructure #SKhynix #MemoryPooling

SK hynix's parent group says it may offer "Memory as a Service" — RAM capacity sold like a cloud subscription rather than a chip in a box. The idea is early, but the hardware underneath it is not.

This explainer walks through the full stack: why memory gets stranded inside servers, how CXL adds the cache coherency that PCIe never had, what memory appliances and CXL 3.0 switches actually do, and why tiering keeps local DRAM first. It also draws a line many articles blur — memory expansion (which Meta already runs across millions of servers, reusing retired DDR4) versus rack-level pooling, which is only now reaching real silicon.

The business angle matters too: subscriptions would smooth the boom-and-bust cycle memory makers have never escaped. And for everyone else, the takeaway is simpler — memory is becoming an asset with value independent of the server it shipped in.

https://www.buysellram.com/blog/memory-as-a-service-cxl/
#MemoryAsAService #CXL #DRAM #DataCenter #AIInfrastructure #SKhynix #MemoryPooling #DDR4 #ServerHardware #Semiconductors #AIHardware #ITAD #technology

SK hynix's parent group says it may offer "Memory as a Service" — RAM capacity sold like a cloud subscription rather than a chip in a box. The idea is early, but the hardware underneath it is not.

This explainer walks through the full stack: why memory gets stranded inside servers, how CXL adds the cache coherency that PCIe never had, what memory appliances and CXL 3.0 switches actually do, and why tiering keeps local DRAM first. It also draws a line many articles blur — memory expansion (which Meta already runs across millions of servers, reusing retired DDR4) versus rack-level pooling, which is only now reaching real silicon.

The business angle matters too: subscriptions would smooth the boom-and-bust cycle memory makers have never escaped. And for everyone else, the takeaway is simpler — memory is becoming an asset with value independent of the server it shipped in.

https://www.buysellram.com/blog/memory-as-a-service-cxl/
#MemoryAsAService #CXL #DRAM #DataCenter #AIInfrastructure #SKhynix #MemoryPooling #DDR4 #ServerHardware #Semiconductors #AIHardware #ITAD #technology

SK hynix's parent group says it may offer "Memory as a Service" — RAM capacity sold like a cloud subscription rather than a chip in a box. The idea is early, but the hardware underneath it is not.

This explainer walks through the full stack: why memory gets stranded inside servers, how CXL adds the cache coherency that PCIe never had, what memory appliances and CXL 3.0 switches actually do, and why tiering keeps local DRAM first. It also draws a line many articles blur — memory expansion (which Meta already runs across millions of servers, reusing retired DDR4) versus rack-level pooling, which is only now reaching real silicon.

The business angle matters too: subscriptions would smooth the boom-and-bust cycle memory makers have never escaped. And for everyone else, the takeaway is simpler — memory is becoming an asset with value independent of the server it shipped in.

https://www.buysellram.com/blog/memory-as-a-service-cxl/
#MemoryAsAService #CXL #DRAM #DataCenter #AIInfrastructure #SKhynix #MemoryPooling #DDR4 #ServerHardware #Semiconductors #AIHardware #ITAD #technology

SK hynix's parent group says it may offer "Memory as a Service" — RAM capacity sold like a cloud subscription rather than a chip in a box. The idea is early, but the hardware underneath it is not.

This explainer walks through the full stack: why memory gets stranded inside servers, how CXL adds the cache coherency that PCIe never had, what memory appliances and CXL 3.0 switches actually do, and why tiering keeps local DRAM first. It also draws a line many articles blur — memory expansion (which Meta already runs across millions of servers, reusing retired DDR4) versus rack-level pooling, which is only now reaching real silicon.

The business angle matters too: subscriptions would smooth the boom-and-bust cycle memory makers have never escaped. And for everyone else, the takeaway is simpler — memory is becoming an asset with value independent of the server it shipped in.

https://www.buysellram.com/blog/memory-as-a-service-cxl/
#MemoryAsAService #CXL #DRAM #DataCenter #AIInfrastructure #SKhynix #MemoryPooling #DDR4 #ServerHardware #Semiconductors #AIHardware #ITAD #technology

SK hynix's parent group says it may offer "Memory as a Service" — RAM capacity sold like a cloud subscription rather than a chip in a box. The idea is early, but the hardware underneath it is not.

This explainer walks through the full stack: why memory gets stranded inside servers, how CXL adds the cache coherency that PCIe never had, what memory appliances and CXL 3.0 switches actually do, and why tiering keeps local DRAM first. It also draws a line many articles blur — memory expansion (which Meta already runs across millions of servers, reusing retired DDR4) versus rack-level pooling, which is only now reaching real silicon.

The business angle matters too: subscriptions would smooth the boom-and-bust cycle memory makers have never escaped. And for everyone else, the takeaway is simpler — memory is becoming an asset with value independent of the server it shipped in.

https://www.buysellram.com/blog/memory-as-a-service-cxl/
#MemoryAsAService #CXL #DRAM #DataCenter #AIInfrastructure #SKhynix #MemoryPooling #DDR4 #ServerHardware #Semiconductors #AIHardware #ITAD #technology