#aiinfra — Public Fediverse posts

NVIDIA's GPU VRAM limits hit? AllSafeUs explores augmenting with system RAM/NVMe. At EnergenAI, TIAMAT runs 120B models with 20M tokens/day on edge clusters. We optimize memory routing across 52 tools—no synthetic VRAM needed. Real efficiency > hacks. #AIInfra #LLMOps #EdgeAI tiamat.live

NVIDIA's GPU VRAM limits hit? AllSafeUs explores augmenting with system RAM/NVMe. At EnergenAI, TIAMAT runs 120B models with 20M tokens/day on edge clusters. We optimize memory routing across 52 tools—no synthetic VRAM needed. Real efficiency > hacks. #AIInfra #LLMOps #EdgeAI tiamat.live

Thanks to everyone who joined our Microsoft Reactor session on secure, observable, production-ready agents. Repo + slides for the demo are here:
https://aka.ms/microsoftnvidiademo

#Azure #NVIDIA #Agents #AIInfra #OpenSource

Thanks to everyone who joined our Microsoft Reactor session on secure, observable, production-ready agents. Repo + slides for the demo are here:
https://aka.ms/microsoftnvidiademo

#Azure #NVIDIA #Agents #AIInfra #OpenSource

Thanks to everyone who joined our Microsoft Reactor session on secure, observable, production-ready agents. Repo + slides for the demo are here:
https://aka.ms/microsoftnvidiademo

#Azure #NVIDIA #Agents #AIInfra #OpenSource

Thanks to everyone who joined our Microsoft Reactor session on secure, observable, production-ready agents. Repo + slides for the demo are here:
https://aka.ms/microsoftnvidiademo

#Azure #NVIDIA #Agents #AIInfra #OpenSource

Thanks to everyone who joined our Microsoft Reactor session on secure, observable, production-ready agents. Repo + slides for the demo are here:
https://aka.ms/microsoftnvidiademo

#Azure #NVIDIA #Agents #AIInfra #OpenSource

Production-ready agents need more than a prompt loop. Join me for a Microsoft Reactor livestream with NVIDIA on a multi-agent architecture where Foundry Agent Service acts as the control plane and GPU-backed agents run on Azure Container Apps.
We’ll walk through document processing, security controls, tracing, and explainable results.
🗓 Mar 11, 2026 • 9 AM PT / 6 PM PT
👉 https://developer.microsoft.com/en-us/reactor/events/26660/

#Azure #NVIDIA #Agents #AIInfra #OpenSource

Production-ready agents need more than a prompt loop. Join me for a Microsoft Reactor livestream with NVIDIA on a multi-agent architecture where Foundry Agent Service acts as the control plane and GPU-backed agents run on Azure Container Apps.
We’ll walk through document processing, security controls, tracing, and explainable results.
🗓 Mar 11, 2026 • 9 AM PT / 6 PM PT
👉 https://developer.microsoft.com/en-us/reactor/events/26660/

#Azure #NVIDIA #Agents #AIInfra #OpenSource

Production-ready agents need more than a prompt loop. Join me for a Microsoft Reactor livestream with NVIDIA on a multi-agent architecture where Foundry Agent Service acts as the control plane and GPU-backed agents run on Azure Container Apps.
We’ll walk through document processing, security controls, tracing, and explainable results.
🗓 Mar 11, 2026 • 9 AM PT / 6 PM PT
👉 https://developer.microsoft.com/en-us/reactor/events/26660/

#Azure #NVIDIA #Agents #AIInfra #OpenSource

Production-ready agents need more than a prompt loop. Join me for a Microsoft Reactor livestream with NVIDIA on a multi-agent architecture where Foundry Agent Service acts as the control plane and GPU-backed agents run on Azure Container Apps.
We’ll walk through document processing, security controls, tracing, and explainable results.
🗓 Mar 11, 2026 • 9 AM PT / 6 PM PT
👉 https://developer.microsoft.com/en-us/reactor/events/26660/

#Azure #NVIDIA #Agents #AIInfra #OpenSource

Production-ready agents need more than a prompt loop. Join me for a Microsoft Reactor livestream with NVIDIA on a multi-agent architecture where Foundry Agent Service acts as the control plane and GPU-backed agents run on Azure Container Apps.
We’ll walk through document processing, security controls, tracing, and explainable results.
🗓 Mar 11, 2026 • 9 AM PT / 6 PM PT
👉 https://developer.microsoft.com/en-us/reactor/events/26660/

#Azure #NVIDIA #Agents #AIInfra #OpenSource

My first time at #SCAsia/#HPCAsia this week. I don’t have a crazy preset agenda as I would at SC/ISC, so looking forward to having time to explore new experiences, hopes, and perspectives on #HPC and #AIinfra, meet people, etc.

My first time at #SCAsia/#HPCAsia this week. I don’t have a crazy preset agenda as I would at SC/ISC, so looking forward to having time to explore new experiences, hopes, and perspectives on #HPC and #AIinfra, meet people, etc.

My first time at #SCAsia/#HPCAsia this week. I don’t have a crazy preset agenda as I would at SC/ISC, so looking forward to having time to explore new experiences, hopes, and perspectives on #HPC and #AIinfra, meet people, etc.

My first time at #SCAsia/#HPCAsia this week. I don’t have a crazy preset agenda as I would at SC/ISC, so looking forward to having time to explore new experiences, hopes, and perspectives on #HPC and #AIinfra, meet people, etc.

My first time at #SCAsia/#HPCAsia this week. I don’t have a crazy preset agenda as I would at SC/ISC, so looking forward to having time to explore new experiences, hopes, and perspectives on #HPC and #AIinfra, meet people, etc.

Neocloud Economics: CoreWeave vs Nebius – Vertical AI Infra Crushes Hyperscalers (60-70% Margins) ⚡

Neoclouds own stack (chips→racks), dodge AWS debt/leasing. Nebius edges CoreWeave on costs; $10B+ ARR potential. AI training explodes demand

Why vertical? 2-3x cheaper GPUs vs cloud giants.

VCs: Next hyperscalers? Founders: Build atop. GPU wars incoming. 📈

#Neocloud #CoreWeave #Nebius #AIInfra #GPUEconomics

https://buff.ly/XJsjWqp

⚡ Cut GPU costs by 68% without slowing inference.
No hype. Just real infra lessons from shipping AI in production.

👉 Read the full story:
https://medium.com/@rogt.x1997/why-my-ai-startup-cut-gpu-costs-by-68-without-slowing-down-with-runpod-58f71733e86f

#GenAI #AIInfra #MLOps
https://medium.com/@rogt.x1997/why-my-ai-startup-cut-gpu-costs-by-68-without-slowing-down-with-runpod-58f71733e86f

⚡ Cut GPU costs by 68% without slowing inference.
No hype. Just real infra lessons from shipping AI in production.

👉 Read the full story:
https://medium.com/@rogt.x1997/why-my-ai-startup-cut-gpu-costs-by-68-without-slowing-down-with-runpod-58f71733e86f

#GenAI #AIInfra #MLOps
https://medium.com/@rogt.x1997/why-my-ai-startup-cut-gpu-costs-by-68-without-slowing-down-with-runpod-58f71733e86f

La IA tiene hambre de energía y la solución es nuclear. ⚛️🤖 Analizamos el proyecto de Last Energy para crear mini reactores. ¿Sostenibilidad real o un riesgo necesario para el progreso tech? https://www.glitchmental.com/2025/12/reactores-nucleares-last-energy-ia-infraestructura.html #Nuclear #AIInfra #MastodonTech #CleanEnergy

ARBITER: what it is / what it isn’t

IS

semantic scoring
geometric fit
negative answers
offline 26MB

ISN’T

LLM
vector DB
embeddings
retrieval

getarbiter.dev
#AI #NLP #RAG #AIInfra #SemanticSearch

ScaleOps' new AI Infra slashes GPU costs by half for self‑hosted LLMs while giving full visibility into pods, model behavior, and even a helm flag for easy tuning. Curious how you can cut spend and keep control? Read the full breakdown. #ScaleOps #AIInfra #GPUcosts #SelfHostedLLMs

🔗 https://aidailypost.com/news/scaleops-ai-infra-cuts-gpu-costs-50-selfhosted-llms-adds-full

ScaleOps' new AI Infra slashes GPU costs by half for self‑hosted LLMs while giving full visibility into pods, model behavior, and even a helm flag for easy tuning. Curious how you can cut spend and keep control? Read the full breakdown. #ScaleOps #AIInfra #GPUcosts #SelfHostedLLMs

🔗 https://aidailypost.com/news/scaleops-ai-infra-cuts-gpu-costs-50-selfhosted-llms-adds-full

🚀 Tired of burning weekends fixing infra? RunPod 2025 makes GPU deploys boring (in the best way). Pods, endpoints & MCP turn ideas into live projects faster than ever. ⚡

👉 Read the full guide:
https://medium.com/@rogt.x1997/pods-endpoints-and-a-smoother-future-the-hidden-simplicity-of-runpod-f9bace9e1a8c

#RunPod #AIInfra #AIBuilders
https://medium.com/@rogt.x1997/pods-endpoints-and-a-smoother-future-the-hidden-simplicity-of-runpod-f9bace9e1a8c

🚀 Tired of burning weekends fixing infra? RunPod 2025 makes GPU deploys boring (in the best way). Pods, endpoints & MCP turn ideas into live projects faster than ever. ⚡

👉 Read the full guide:
https://medium.com/@rogt.x1997/pods-endpoints-and-a-smoother-future-the-hidden-simplicity-of-runpod-f9bace9e1a8c

#RunPod #AIInfra #AIBuilders
https://medium.com/@rogt.x1997/pods-endpoints-and-a-smoother-future-the-hidden-simplicity-of-runpod-f9bace9e1a8c

🚀 Tired of burning weekends fixing infra? RunPod 2025 makes GPU deploys boring (in the best way). Pods, endpoints & MCP turn ideas into live projects faster than ever. ⚡

👉 Read the full guide:
https://medium.com/@rogt.x1997/pods-endpoints-and-a-smoother-future-the-hidden-simplicity-of-runpod-f9bace9e1a8c

#RunPod #AIInfra #AIBuilders
https://medium.com/@rogt.x1997/pods-endpoints-and-a-smoother-future-the-hidden-simplicity-of-runpod-f9bace9e1a8c

🚀 Tired of burning weekends fixing infra? RunPod 2025 makes GPU deploys boring (in the best way). Pods, endpoints & MCP turn ideas into live projects faster than ever. ⚡

👉 Read the full guide:
https://medium.com/@rogt.x1997/pods-endpoints-and-a-smoother-future-the-hidden-simplicity-of-runpod-f9bace9e1a8c

#RunPod #AIInfra #AIBuilders
https://medium.com/@rogt.x1997/pods-endpoints-and-a-smoother-future-the-hidden-simplicity-of-runpod-f9bace9e1a8c

🇹🇼 #ASUS subsidiary #TaiwanAICLOUD building NVIDIA‑powered supercomputer (80→250 PFLOPS).
https://www.scmp.com/tech/tech-trends/article/3322882/taiwanese-laptop-maker-asus-subsidiary-builds-supercomputer-boost-islands-capacity
#NVIDIA #HPC #AIInfra #Taiwan

🇹🇼 #ASUS subsidiary #TaiwanAICLOUD building NVIDIA‑powered supercomputer (80→250 PFLOPS).
https://www.scmp.com/tech/tech-trends/article/3322882/taiwanese-laptop-maker-asus-subsidiary-builds-supercomputer-boost-islands-capacity
#NVIDIA #HPC #AIInfra #Taiwan

🇹🇼 #ASUS subsidiary #TaiwanAICLOUD building NVIDIA‑powered supercomputer (80→250 PFLOPS).
https://www.scmp.com/tech/tech-trends/article/3322882/taiwanese-laptop-maker-asus-subsidiary-builds-supercomputer-boost-islands-capacity
#NVIDIA #HPC #AIInfra #Taiwan

🇹🇼 #ASUS subsidiary #TaiwanAICLOUD building NVIDIA‑powered supercomputer (80→250 PFLOPS).
https://www.scmp.com/tech/tech-trends/article/3322882/taiwanese-laptop-maker-asus-subsidiary-builds-supercomputer-boost-islands-capacity
#NVIDIA #HPC #AIInfra #Taiwan

🇹🇼 #ASUS subsidiary #TaiwanAICLOUD building NVIDIA‑powered supercomputer (80→250 PFLOPS).
https://www.scmp.com/tech/tech-trends/article/3322882/taiwanese-laptop-maker-asus-subsidiary-builds-supercomputer-boost-islands-capacity
#NVIDIA #HPC #AIInfra #Taiwan

🔀 LiteLLM @LiteLLM

Open-source LLM gateway + Python SDK for 100+ providers in OpenAI format. Integrates with Langfuse/LangSmith/OTEL for unified views.

https://www.everydev.ai/tools/litellm

#OpenSource #UnifiedAPI #LLMOrchestration #AIInfra #DevTools

🛰️ Martian @withmartian

OpenAI LLM router with a willingness_to_pay knob—adjust the base_url to select the best model (cost × quality × latency). Includes open-source adapters for easy multi-model use.

https://www.everydev.ai/tools/martian

#LLM #ModelRouter #AIInfra #DevTools #OpenAIAPI

Hey! We're new here (and we just launched!).

Here at alpic, we believe every online service will soon need an interface for agents, not just humans. MCP is the protocol; Alpic is the infra.

Why now ? Why us? We wrote a little something for you here: https://alpic.ai/blog/welcome-to-alpic

#mcp #agenticAI #AIinfra

Here’s the full roadmap slide from the event:
👇

#MCP #AIInfra #Anthropic #Microsoft #DevDays #AgentTech #AIprotocols #MCPDevDays

💅 Deploying AI infra like a queen?

Meet Docker MCP - agents up in seconds, safety built-in, scaling? Just add vibes.

This is DevOps, but make it 🔥smart + pretty.

🎥 Watch the magic → https://youtube.com/shorts/ettAJBLH59Y

#DevOpsGirl #Docker #AIInfra #CloudNative #InfraAsCode

💅 Deploying AI infra like a queen?

Meet Docker MCP - agents up in seconds, safety built-in, scaling? Just add vibes.

This is DevOps, but make it 🔥smart + pretty.

🎥 Watch the magic → https://youtube.com/shorts/ettAJBLH59Y

#DevOpsGirl #Docker #AIInfra #CloudNative #InfraAsCode

💅✨ What powers AI behind the scenes?

Time to spill the DevOps tea 🫖 on Docker MCP

💻⚙️ Smart infra, sleek containers, & cloud-native magic in under 60 secs 💥

🎀 Watch now & level up → https://youtube.com/shorts/-zl2V2ZTuNk

#DevOpsGirl #DockerMCP #CloudNative #AIInfra #TechTok

💅✨ What powers AI behind the scenes?

Time to spill the DevOps tea 🫖 on Docker MCP

💻⚙️ Smart infra, sleek containers, & cloud-native magic in under 60 secs 💥

🎀 Watch now & level up → https://youtube.com/shorts/-zl2V2ZTuNk

#DevOpsGirl #DockerMCP #CloudNative #AIInfra #TechTok

💻💅 Running AI agents? You better isolate them, babe.

Docker MCP got your back with ✨secure containers✨ - no bugs, no drama.

Smart infra is sexy, and so are you. 😘

Watch me break it down 👉 https://youtube.com/shorts/-zoJhRARTDU

#DevOpsGirl #AIInfra #CloudNative #Docker #TechBaddie

💻💅 Running AI agents? You better isolate them, babe.

Docker MCP got your back with ✨secure containers✨ - no bugs, no drama.

Smart infra is sexy, and so are you. 😘

Watch me break it down 👉 https://youtube.com/shorts/-zoJhRARTDU

#DevOpsGirl #AIInfra #CloudNative #Docker #TechBaddie

💅 DevOps just got cuter - and smarter 😏

Docker’s new MCP Toolkit comes with 100+ AI agents ready to slay your infra game 🛠️✨

Tap into that cloud-native power, queen 👑

👉 Watch now: https://youtube.com/shorts/hwQItyKvFlo

#DevOpsGirl #DockerMagic #AIInfra #CloudBabe

💅 DevOps just got cuter - and smarter 😏

Docker’s new MCP Toolkit comes with 100+ AI agents ready to slay your infra game 🛠️✨

Tap into that cloud-native power, queen 👑

👉 Watch now: https://youtube.com/shorts/hwQItyKvFlo

#DevOpsGirl #DockerMagic #AIInfra #CloudBabe

🚨 Amazon Q isn’t magic… but it’s a total GAME-CHANGER for DevOps 👩‍💻💥

⚠️ Still in Preview
⚙️ Needs tweaks
💻 Shines in your CLI & IDE

If you’re into Terraform + AI infra — this is for you 👇

🎥 https://youtube.com/shorts/wzhBeKcfZPM

#DevOps #AmazonQ #AIInfra #CloudNative #SRE #Terraform

🚨 Amazon Q isn’t magic… but it’s a total GAME-CHANGER for DevOps 👩‍💻💥

⚠️ Still in Preview
⚙️ Needs tweaks
💻 Shines in your CLI & IDE

If you’re into Terraform + AI infra — this is for you 👇

🎥 https://youtube.com/shorts/wzhBeKcfZPM

#DevOps #AmazonQ #AIInfra #CloudNative #SRE #Terraform

🚨 Amazon Q isn’t magic… but it’s a total GAME-CHANGER for DevOps 👩‍💻💥

⚠️ Still in Preview
⚙️ Needs tweaks
💻 Shines in your CLI & IDE

If you’re into Terraform + AI infra — this is for you 👇

🎥 https://youtube.com/shorts/wzhBeKcfZPM

#DevOps #AmazonQ #AIInfra #CloudNative #SRE #Terraform

🗳️ Poll for AI builders:

𝗪𝗵𝗮𝘁’𝘀 𝘄𝗲𝗶𝗴𝗵𝗶𝗻𝗴 𝗵𝗲𝗮𝘃𝗶𝗲𝘀𝘁 𝗼𝗻 𝘆𝗼𝘂𝗿 𝗱𝗮𝘁𝗮-𝗽𝗿𝗶𝘃𝗮𝗰𝘆 𝗺𝗶𝗻𝗱 𝗿𝗶𝗴𝗵𝘁 𝗻𝗼𝘄?
(Pick one — feel free to elaborate in the replies.)

#AIPrivacy #LLM #DataPrivacy #MLOps #Security #PrivacyTech #AIBuilders #AIInfra #CyberSecurity #Fediverse #Mastodon

🗳️ Poll for AI builders:

𝗪𝗵𝗮𝘁’𝘀 𝘄𝗲𝗶𝗴𝗵𝗶𝗻𝗴 𝗵𝗲𝗮𝘃𝗶𝗲𝘀𝘁 𝗼𝗻 𝘆𝗼𝘂𝗿 𝗱𝗮𝘁𝗮-𝗽𝗿𝗶𝘃𝗮𝗰𝘆 𝗺𝗶𝗻𝗱 𝗿𝗶𝗴𝗵𝘁 𝗻𝗼𝘄?
(Pick one — feel free to elaborate in the replies.)

#AIPrivacy #LLM #DataPrivacy #MLOps #Security #PrivacyTech #AIBuilders #AIInfra #CyberSecurity #Fediverse #Mastodon