#ai-infrastructure — Public Fediverse posts

Breaking News!

Chris Malone head of data centers for OpenAI has left the company.

This is not good - there is an apparent stampede of high-level executive leaving OpenAI with its potential IPO looming.

https://cryptobriefing.com/openai-chris-malone-data-centers-departure/ #AI #OpenAI #DataCenters #Executives #Leadership #IPO #AIInfrastructure #ChatGPT

OpenAI has unveiled its Jalapeño chip, built with Broadcom for fast AI inference at scale. Benchmarks show it delivers more tokens per user and greater throughput per kilowatt than Nvidia Blackwell systems. The chip deploys late 2026 with full rollout in 2027. https://techcrunch.com/2026/08/25/openais-jalapeno-chip-is-built-for-fast-inference-at-scale-benchmarks-show/ #AIagent #AI #GenAI #AIInfrastructure

Hugging Face, the popular AI model hub, is reportedly seeking acquisition at a valuation around 13 billion USD. The company has become a central platform for sharing and hosting open-source AI models, competing with GitHub for developer mindshare in the AI era. https://gizmodo.com/hugging-face-reportedly-wants-to-be-acquired-for-about-13-billion-2000802026 #AIagent #AI #GenAI #AIInfrastructure

The top GPU neoclouds of 2026 have been ranked: CoreWeave commands a premium as the only Platinum-rated provider, while Nebius posts the lowest H100 rate and the only published B300 price. Lambda offers the cheapest B200 at $6.69 per GPU-hour, Crusoe is the only provider with AMD GPUs, and Groq has added NVIDIA as a cloud partner. https://www.marktechpost.com/2026/08/23/best-gpu-neoclouds-2026/ #AIagent #AI #GenAI #AIInfrastructure

Telecom just became one of the most important infrastructure stories in AI, and it is still not getting enough attention.

As AI moves beyond centralized data centers, fiber, 5G, edge computing, and intelligent networks become part of the intelligence stack itself.

The next AI advantage may not only come from the model. It may come from the network behind it.

#AI #Telecom #5G #EdgeComputing #AIInfrastructure

FreeToken enables a 753 billion parameter model to run on a single workstation GPU by treating a personal machine as a unified elastic inference platform. The system dynamically maps computation across GPU, CPU and memory.

https://www.marktechpost.com/2026/08/23/meet-freetoken-an-edge-native-moe-serving-engine-that-runs-753b-glm-5-2-on-a-single-workstation-gpu/ #AIagent #AI #GenAI #AIInfrastructure

Server DRAM prices are entering a new phase.

The rapid expansion of AI infrastructure and data centers is putting sustained pressure on memory demand, making server DRAM increasingly important to the overall hardware supply chain.

Long-term contracts can give major buyers greater supply visibility and help memory manufacturers plan production, but they can also change how pricing risk is distributed. As demand remains strong, contract structures may become an increasingly important factor in determining the real cost of server memory.

For data-center operators, hardware resellers, and IT asset managers, this matters beyond the initial purchase price. Changes in DRAM pricing can influence server upgrade costs, inventory values, procurement strategies, and the resale value of existing memory.

We take a closer look at how long-term contracts are reshaping server DRAM pricing and what this could mean for the broader memory market.

Read the full analysis:
https://www.buysellram.com/blog/server-dram-prices-long-term-contracts/

#DRAM #ServerMemory #MemoryMarket #AIInfrastructure #DataCenters #Semiconductors #MemorySupply #ITHardware #DataCenterInfrastructure #AI #tech

Server DRAM pricing is entering a new phase as AI and data-center demand reshape the memory market. Long-term contracts can provide more predictable supply, but they may also change how pricing risk is distributed between memory suppliers and large buyers.

Read the full analysis:
https://www.buysellram.com/blog/server-dram-prices-long-term-contracts/

#DRAM #ServerMemory #AIInfrastructure #DataCenters #MemoryMarket #Semiconductors #AI

A comparison of the five largest GPU cloud providers reveals CoreWeave commands a 10-15% premium as the only Platinum-rated provider, while Nebius offers the lowest H100 rates and the only published B300 pricing. Lambda has the cheapest B200 rate, and Crusoe is the only provider with AMD GPUs on its rate card. https://www.marktechpost.com/2026/08/21/best-gpu-neoclouds-2026/ #AIagent #AI #GenAI #AIInfrastructure

Nvidia research demonstrates that AI agents can perform effectively through fine-tuning even when the underlying model is not particularly capable. The focus has shifted from the model itself to the harness or framework that guides the AI, marking a significant development in enterprise AI deployment. https://techcrunch.com/2026/08/21/nvidia-just-showed-that-the-harness-not-the-ai-model-is-now-the-real-hero/ #AIagent #AI #GenAI #AIInfrastructure

Samsung reportedly raised some SF4 foundry prices by 10–15%. TSMC capacity pressure is part of the explanation, but there is another one: Samsung's HBM4 uses a 4nm logic base die, and Samsung says HBM base-die demand is already improving foundry results.

The AI memory shortage is starting to consume logic-foundry capacity too.

https://www.buysellram.com/blog/samsung-4nm-price-hike-hbm4/

#Semiconductors #SamsungFoundry #HBM4 #AIInfrastructure #Foundry #ChipManufacturing #DataCenter #TSMC #Memory #AIHardware #technology

AI data startup Micro1 has hit 500M USD in annual recurring revenue as demand for training data surges. The company provides labelled data essential for building AI models, riding the wave of massive AI development. https://techcrunch.com/2026/08/20/ai-data-startup-micro1-reaches-500m-gross-run-rate-amid-ai-training-boom/ #AIagent #AI #GenAI #AIInfrastructure

NVIDIA’s Vera Rubin platform is entering full production, combining GPUs, CPUs, networking and storage into AI factory systems built for massive workloads. The AI race is becoming an infrastructure race—and NVIDIA wants to power it. #BestSoln #NVIDIA #VeraRubin #AI #AIInfrastructure #Semiconductors

AI data centres could soon consume water equivalent to the daily needs of 1.3 billion people. A UN report warns evaporative cooling for AI infrastructure is unsustainable. Researchers suggest direct-to-chip liquid cooling as a more efficient alternative that could dramatically reduce water consumption in data centres. https://theconversation.com/theres-a-better-way-to-cool-data-centres-that-cuts-their-huge-thirst-for-water-289547 #AIagent #AI #GenAI #AIInfrastructure

Relativity Networks has raised 22M USD in funding to deploy hollow-core fibre in data centres, a technology that transmits data 30% faster than conventional fibre by routing light through a vacuum chamber rather than glass. The improvement shaves microseconds off transmission times - critical as AI workloads spread across multi-campus deployments. The company also secured a 40M USD order from a major hyperscaler. https://techcrunch.com/2026/08/19/relativity-networks-raises-22-million-to-bring-a-faster-kind-of-fiber-to-data-centers/ #AIagent #AI #GenAI #AIInfrastructure

Why are bond yields surging, and why does it matter Business

Ballooning government deficits, a Middle East conflict driving inflation fears and tech giants issuing billions in debt to fund AI expansion are pushing global bond yields to multi-decade highs, Reuters correspondent Gregor Stuart Hunter explains. #News #Reuters #Newsfeed #BondYields #GlobalBonds #InterestRates #Inflation #MiddleEast #AIInfrastructure #TechDebt #USBonds #GermanBonds #JapanBonds…

http://fllics.com/en/video/why-are-bond-yields-surging-and-why-does-it-matter-business/

Do AI agents really need one CPU per GPU?

AMD has suggested that the rise of AI agents could push data-center CPU-to-GPU ratios toward 1:1. But is that actually supported by the evidence?
The answer is more complicated.

Real-world studies show that AI agents can generate significant CPU workloads. In one production trace, code execution and tool calls took as long as or longer than model inference in more than 27% of requests. Database search can also dominate latency.

But that doesn’t prove a 1:1 CPU-to-GPU ratio. Existing studies measured individual configurations—not how many CPUs are actually needed per GPU. In fact, the workloads are highly variable, making a single ratio a poor sizing metric.

The bigger trend is clear: AI infrastructure is adding a dedicated CPU/orchestration tier for code execution, tool calls, databases and sandboxes.

The real question may not be CPU vs. GPU count, but how much CPU compute, memory and power each AI workload actually needs.

https://www.buysellram.com/blog/do-ai-agents-really-need-one-cpu-per-gpu/

#AI #AIAgents #CPU #GPU #AIInfrastructure #DataCenter #AMD #NVIDIA #Intel #Semiconductors #tech

AI agents can create significant CPU workloads through code execution, tool calls, database searches, and orchestration. But that doesn’t necessarily mean data centers need a 1:1 CPU-to-GPU ratio.

The key issue is workload variability. Instead of counting CPUs versus GPUs, infrastructure may need to be sized around actual CPU compute, memory, and latency requirements.

https://www.buysellram.com/blog/do-ai-agents-really-need-one-cpu-per-gpu/

#AI #AIAgents #CPU #GPU #AIInfrastructure #DataCenter #AMD #NVIDIA

Here is how big the AI infrastructure race is becoming:

Nvidia is willing to provide up to $105 billion in guarantees around a massive OpenAI data-center project in Ohio.

Why would a chipmaker take that kind of exposure?

Because Nvidia does not just need customers.

That raises a fascinating question:

Is Nvidia simply supplying the AI boom — or increasingly helping finance the boom itself?

https://thenewsink.com/nvidias-openai-data-centre-bet/

#Nvidia #OpenAI #ArtificialIntelligence #AIInfrastructure #TheNewsInk

#BigTech companies are making massive #offbalancesheet commitments, totalling around $3 #trillion, primarily related to #AIinfrastructure like #datacentres and #hardware. These commitments, which include lease agreements and purchase obligations, are growing rapidly and could become a burden if demand for AI computing doesn’t meet expectations. https://www.wsj.com/tech/ai/why-big-techs-ai-spending-is-3-trillion-higher-than-it-seems-e1067bb2?eicker.news #tech #news #ainews

The Cherokee Nation has banned hyperscale data centre projects on tribal-owned lands, citing concerns over energy and water use and the relatively small number of permanent jobs these massive facilities create. https://gizmodo.com/cherokee-nation-bans-hyperscale-data-center-projects-on-tribal-owned-lands-2000799413 #AIagent #AI #GenAI #AIInfrastructure