#ai-infrastructure — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #ai-infrastructure, aggregated by home.social.
-
Meta has unveiled ZGateway, a stateless proxy tier that handles over 1 billion operations per second for its ZippyDB key-value store. The system reduces connection counts by around 97-98% and is projected to carry 60% of traffic at just 6% computational overhead. https://www.marktechpost.com/2026/09/14/meta-introduces-zgateway-a-stateless-proxy-tier-that-unifies-zippydb-traffic-and-handles-over-1-billion-operations-per-second/ #AIagent #AI #GenAI #AIInfrastructure
-
NVIDIA has open-sourced OSMO, a workflow orchestrator that lets robotics teams define training, simulation, and robot testing in a single YAML file. The tool routes tasks across different compute tiers from GB200 clusters to Jetson devices, tackling what NVIDIA calls the three computer problem of physical AI development. Apache-2.0 licensed. https://www.marktechpost.com/2026/09/14/nvidia-open-sources-osmo-one-yaml-orchestrates-physical-ai-training-simulation-and-robot-testing/ #AIagent #AI #GenAI #AIInfrastructure
-
Lorenzo Simonelli notes that high interest rates are failing to slow the energy boom. While many expected elevated borrowing costs to cool investment, robust demand for natural gas and power driven by global AI infrastructure is pushing projects forward. Driven by long-term contracts and a massive backlog of over $37 billion, companies see these demands as non-negotiable. This shift highlights how technological growth reshapes energy priorities even amidst inflation. Read more about the future of LNG and demand at the link below. Great analysis by Lorenzo Simonelli.
https://www.cnbc.com/2026/09/14/baker-hughes-ceo-no-slowdown-in-energy-projects-despite-higher-rates-.html #EnergyTransition #AIinfrastructure #LNG #NaturalGas #BakerHughes -
Data centres are at the centre of a heated policy debate in Australia, with community opposition growing across the country. The Conversation answers nine key questions from readers about what data centres store, who owns it, regulation, water usage, and what happens when the AI bubble pops. https://theconversation.com/data-centres-in-australia-your-questions-answered-290841 #AIagent #AI #GenAI #AIInfrastructure
-
A fast GPU doesn't mean a fast pipeline. If storage can't deliver data quickly enough, your GPU ends up waiting no matter how powerful it is.
Our latest guide covers PCIe Gen5 NVMe throughput vs. Gen3/Gen4, how GPUDirect Storage bypasses the CPU to feed GPU VRAM directly, PCIe lane planning for multi-GPU servers, and how to check whether storage is actually your bottleneck before upgrading.
📖 Read it here: https://www.fitservers.com/blogs/pcie-gen5-nvme-gpu-servers-storage-bottleneck/
#PCIeGen5 #NVMe #AIInfrastructure #ServerHardware #DataCenter
-
Selling retired enterprise GPUs is not just a pricing exercise.
A strong quote can become less attractive once freight, inspection rights, repricing, payment timing, and internal staff time are included.
Our new guide looks at how to prepare GPU inventory, compare buyers, document health data, and manage the transaction before the hardware ships.
https://www.buysellram.com/blog/selling-retired-enterprise-gpus-ai-accelerators/
#ITAD #EnterpriseGPU #AIInfrastructure #DataCenter #AssetDisposition #BuySellRAM #Nvidia #AMD #A100 #H100 #H200
-
Open should mean more than downloadable weights.
K2 Horizon releases six models—from 0.9B to 375B parameters—together with training code, data or recipes, checkpoints and evaluations.
This makes model development inspectable and reproducible: an important reference point for sovereign AI.
https://ifm.ai/k2/
#OpenSourceAI #SovereignAI #AIInfrastructure -
Nvidia has agreed to buy Hugging Face, the popular platform for hosting millions of open AI models, for 13B USD. The chip giant says the acquisition will accelerate the spread of open-weight AI models. Hugging Face will remain open despite the takeover. https://arstechnica.com/ai/2026/09/nvidia-buys-hugging-face-the-github-of-ai-for-13-billion/ #AIagent #AI #GenAI #AIInfrastructure
-
AI infrastructure startup Crusoe has raised 3B USD at a 30B USD valuation, according to reports. The funding round came together after the data centre developer secured a 13B USD contract with Jane Street. The deal signals continued massive investment in AI computing infrastructure. https://techcrunch.com/2026/09/03/crusoe-reportedly-raises-3b-at-a-30b-valuation/ #AIagent #AI #GenAI #AIInfrastructure
-
NVIDIA has agreed to acquire Hugging Face for nearly $13 billion.
This raises an interesting structural question for AI: can models & tools become increasingly open while the infrastructure around them becomes more concentrated?
We look at Hugging Face’s role in the open AI ecosystem, NVIDIA expanding position across the AI stack and why hardware neutrality and interoperability will be worth watching.
#NVIDIA #HuggingFace #AI #OpenSource #AIInfrastructure #OpenModels
-
India’s AI infrastructure race is scaling fast. 🇮🇳
Yotta plans to order 50,000 NVIDIA Vera Rubin GPUs (~$7.5B), plus 45,000 GB300 GPUs.
The race isn’t just for AI models, it’s for the compute to run them at scale. 🚀
-
Perplexity has open sourced Lily, a Rust and Metal inference engine for running Qwen3.6-35B-A3B on Apple Silicon. The specialised engine achieves 1.23x faster prefill and 1.35x faster decode than MLX-LM, demonstrating how narrow hardware optimisation can beat general-purpose frameworks. https://www.marktechpost.com/2026/09/02/perplexity-open-sources-lily-a-rust-metal-inference-engine-for-qwen3-6-35b-a3b-on-apple-silicon/ #AIagent #AI #GenAI #AIInfrastructure
-
Nvidia is projecting sales growth of up to 70%, and the reason goes far beyond chatbots and coding assistants. What we're witnessing is the physical build-out of AI itself — data centers, power grids, GPUs, and networking infrastructure being deployed at a scale the tech industry has never seen.
#nvidia #technews #artificialintelligence #aiinfrastructure #futureoftech #startupnews #techtrends #innovations #datacenters #techindustry
-
**RAM prices are undergoing one of the most significant increases the memory market has seen in recent years.**
The latest BuySellRam market update highlights just how dramatic the move has been: **DDR5 prices have increased by as much as 473% in 2026**. This is not simply a normal cycle of memory pricing. The market is being reshaped by the rapid expansion of AI infrastructure, data-center demand, and the growing amount of memory required by modern computing systems.
AI servers are consuming enormous amounts of DRAM and high-bandwidth memory, putting additional pressure on an already constrained supply chain. At the same time, memory manufacturers have to balance capacity between conventional DRAM, server memory, HBM, and other high-value products. As AI-related demand continues to compete for manufacturing capacity, traditional PC and server memory can also feel the effects.
For PC builders, the result is higher system costs. For enterprises and data-center operators, expensive DRAM can significantly increase the cost of server upgrades and infrastructure expansion. A memory shortage can also change procurement strategies, encouraging businesses to extend the useful life of existing servers and pay closer attention to their current hardware inventory.
There is another important consequence: **the secondary RAM market becomes more valuable when new memory becomes expensive.** DDR4 and DDR5 modules that might previously have been considered low-value surplus can become meaningful assets when replacement costs rise sharply. Organizations refreshing servers or consolidating infrastructure should therefore consider the resale value of their existing memory rather than automatically treating it as obsolete equipment.
The 473% increase also raises a broader question about how sustainable current memory pricing is. If AI infrastructure continues to absorb a growing share of global memory production, the traditional boom-and-bust DRAM cycle could look very different in the years ahead.
This market is worth watching closely—not only for buyers of new hardware, but also for companies holding large inventories of **server RAM, DDR4, and DDR5**.
https://www.buysellram.com/blog/ram-market-update/
#RAM #DDR5 #DDR4 #DRAM #Memory #MemoryMarket #AIInfrastructure #DataCenters #ServerMemory #Semiconductors #PCHardware #ITHardware #DataCenter #AI #HardwareMarket
