#rackscale — Public Fediverse posts

#AMD #Helios Architecture Deep Dive: The Power of AMD's Hardware Combined
Increasingly serving as the backbone of #datacenter #AI hardware, #rackscale systems have come to the fore as AI workloads are too large for a single server, both in terms of processing power and memory capacity. The next step beyond a single server, then, is that rackscale systems are all about clustering multiple servers, and multiple types of servers, to function as a single coherent machine.
https://www.servethehome.com/amd-helios-architecture-deep-dive-amd-broadcom-hardware-combined/

Price of #Nvidia's #VeraRubin #NVL72 racks skyrockets to $8.8M apiece, but #server makers' margins will be tight — Nvidia is moving closer to shipping entire full-scale systems
#Blackwell #NVL72 #rackscale system costs $2.8 – $3.4M for an #AI training and #HPC NVL72 #GB200 and $6M to $6.5M for an AI inference NVL72 #GB300
Vera Rubin NVL72 #VR200 systems are currently quoted at $5M - $7M per unit.
Nvidia has never confirmed the list prices of its NVL72 or #NVL144 products.
https://www.tomshardware.com/tech-industry/artificial-intelligence/price-of-nvidias-vera-rubin-nvl72-racks-skyrockets-to-as-much-as-usd8-8-million-apiece-but-server-makers-margins-will-be-tight-nvidia-is-moving-closer-to-shipping-entire-full-scale-systems

#AMD Says “#Helios” Racks And #MI400 Series #GPU On Track For 2H 2026
AMD has been working on the Open Rack Wide v3 specification, a double-wide rack that AMD calls “Helios” and that is the platform for delivering #rackscale compute based on the “Altair” MI400 series GPU accelerators. This series includes the #MI450, #MI430X, and the #MI455X for the Helios rackscale systems, which will have 64, 72, or 128 GPUs per system, and possibly MI440X for eight-way system nodes.
https://www.nextplatform.com/2026/02/23/amd-says-helios-racks-and-mi400-series-gpus-on-track-for-2h-2026/

#AMD threatens to go medieval on Nvidia with #Epyc and #Instinct: What we know so far
AMD teased its next-generation #AI accelerators at #CES2026, with CEO Lisa Su boasting the #MI500-series will deliver a 1,000x uplift in performance over its two-year-old #MI300X #GPU.
if AMD wants to stay competitive with Nvidia, MI500-series will need to deliver performance on par with if not better than Rubin Ultra Kyber racks.
AMD joins the #rackscale race with #MI455X #Helios racks.
https://www.theregister.com/2026/01/07/mi500x_amd_ai/

#Nvidia’s #VeraRubin Platform Obsoletes Current AI Iron Six Months Ahead Of Launch
Nvidia’s top brass says Vera-Rubin #NVL72 #rackscale system, with 72 GPU sockets and 36 CPU sockets as well as NVSwitch fabric linking the, delivers a 10X reduction in #inference cost per token for MoE #AI models and 4X reduction in number of GPUs (but maybe not a 4X reduction in cost, be careful) to train those models compared to the prior generation of #GraceBlackwell NVL72 systems.
https://www.nextplatform.com/2026/01/05/nvidias-vera-rubin-platform-obsoletes-current-ai-iron-six-months-ahead-of-launch/

#AMD touts Instinct #MI430X, #MI440X, and #MI455X #AI accelerators and #Helios #rackscale AI architecture at CES — full MI400-series family fulfills a broad range of infrastructure and customer requirements
The newly disclosed MI440X and MI455X are set to be optimized for low-precision workloads, such as FP4, FP8, & BF16. The previously disclosed MI430X targets both sovereign AI and #HPC thus fully supports FP32 and FP64 technical computing and traditional #supercomputing
https://www.tomshardware.com/tech-industry/artificial-intelligence/amd-touts-instinct-mi430x-mi440x-and-mi455x-ai-accelerators-and-helios-rack-scale-ai-architecture-at-ces-full-mi400-series-family-fulfills-a-broad-range-of-infrastructure-and-customer-requirements

#HPE to ship #rackscale #AI system using #AMD's #Helios in #2026
Announced ahead of HPE's Discover event in Barcelona this week. Helios is intended to operate a rack full of nodes fitted with accelerators as if they were one single large #GPU, like Nvidia's DGX GB200 NVL72 system, to which Helios is pitched as a rival. Helios will be a vehicle for its next-generation Instinct #MI455X GPUs and its 6th-gen Epyc CPUs, codenamed Venice, both of which are due next year.
https://www.theregister.com/2025/12/02/hpe_amd_helios_racks/

#AMD taking #AI fight to #Nvidia with #Helios #rackscale system
#CEO #LisaSu says next-gen #MI400 #GPU and architecture gaining traction with #hyperscalers
"Helios integrates our Instinct MI400 Series GPUs, Epyc Venice CPUs and Pensando NICs in a double-wide rack solution optimized for the performance, power, cooling and serviceability required for the next generation of AI infrastructure and supports Meta's new open rack wide standard," Su said
https://www.theregister.com/2025/11/05/amd_pins_its_hopes_on/

NextGen #MI450 #AI Lineup, #AMD Says There Will Be ‘No Excuses, No Hesitation’ in Choosing Team Red Over NVIDIA In AI Workloads
In terms of what to expect with #MI400 lineup, you are looking at integration of #HBM4, up to 432 GB, this will bring massive bandwidth improvements. AMD plans to aggressively expand #rackscale options with MI400 series as well, introducing highly anticipated #Helios rack as well, which is claimed to rival Vera Rubin's top configuration on-paper.
https://wccftech.com/with-the-mi450-amd-says-there-will-be-no-excuses-no-hesitation-in-choosing-team-red-over-nvidia/

#Arm wrestles away 25% share of #server market thanks to Nvidia's home-grown #CPU
That’s up from 15% of the server market a year ago but still far short of 50% market share Arm infra chief was hoping for. Driving force behind this trend is adoption of Nvidia’s #GraceBlackwell #rackscale compute platforms like GB200 and GB300 #NVL72. Each of the 120-kilowatt machines is equipped with 72 Blackwell GPUs and 36 of Nvidia’s Grace CPUs based on the Arm #NeoverseV2 architecture.
https://www.theregister.com/2025/09/11/nvidias_graceblackwell_drives_arms_cpu/

#RackScale is on the rise, but it's not for everyone... yet
Still buying B200s and MI300Xs? Don't feel bad, #Nvidia and #AMD's #NVL72 and #Helios rack systems aren't really for the #enterprise anyway
With all the hype around Nvidia's NVL72, AMD's newly announced Helios, and Intel's upcoming Jaguar Shores rack systems, you'd be forgiven for thinking the days of eight-way HGX servers are numbered.
Spoiler alert: they're probably not going anywhere anytime soon
https://www.theregister.com/2025/06/17/rack_scale_ai/

#Nvidia's Arm chips rapidly gain share in #server market as #AI booms — Nvidia's Arm-powered #GB200 servers surge as market reaches a record $95 billion in the first quarter
It appears that the vast majority of these Arm-powered machines are Nvidia's #GB200 #NVL72 #rackscale solution, based on the Grace Blackwell platform, which features an Nvidia Grace CPU and eight B200 AI GPUs per server.
https://www.tomshardware.com/desktops/servers/nvidias-arm-chips-rapidly-gain-share-in-server-market-as-ai-booms-nvidias-arm-powered-gb200-servers-surge-as-market-reaches-a-record-usd95-billion-in-the-first-quarter

AMD's AI Future Is Rack Scale 'Helios'

https://morethanmoore.substack.com/p/amds-ai-future-is-rack-scale-helios

#HackerNews #AMD #AI #Helios #RackScale #Future #Technology