Adam :redhat: :ansible: :bash:

Red Hat and Tesla engineers tackled a real production problem together.

3x output tokens/sec, 2x faster TTFT on Llama 3.1 70B with KServe + llm-d + vLLM. Fixes pushed upstream to KServe along the way.

This is what open source looks like. 🤝 🚀

https://llm-d.ai/blog/production-grade-llm-inference-at-scale-kserve-llm-d-vllm

#RedHat #Tesla #RedHatAI #vLLM #Pytorch #Kubernetes #OpenShift #KServe #llmd #Llama #OpenSource

pip install vllm: The iceberg under a single command

https://developers.redhat.com/articles/2026/04/16/pip-install-vllm-single-command#

#Python #RedHat #vLLM #OpenSource #Linux #Pytorch #AI

233% 3-year return on investment and 13 months to payback with Red Hat AI

https://www.redhat.com/en/blog/233-3-year-return-investment-and-13-months-payback-red-hat-ai

#RedHat #AI #RedHatAI #OpenSource #OpenShift #RHEL #Kubernetes #vLLM

Red Hat AI tops MLPerf Inference v6.0 with vLLM on Qwen3-VL, Whisper, and GPT-OSS-120B

https://www.redhat.com/en/blog/red-hat-ai-tops-mlperf-inference-v60-vllm-qwen3-vl-whisper-and-gpt-oss-120b

#RedHat #RHEL #OpenShift #AI #RHAI #RHELAI #OpenShiftAI #OpenSource #Linux #vLLM

Red Hat AI 3 is GA!

https://docs.redhat.com/en/documentation/red_hat_ai/3

#RedHat #RedHatAI #RHAIIS #OpenShift #OpenShiftAI #vLLM #KServe #Kubeflow #llmd #AI #GenAI #AIPlatform #OpenSource #OpenSourceAI

KServe joins CNCF as an incubating project

https://www.redhat.com/en/blog/kserve-joins-cncf-incubating-project

#RedHat #Kubernetes #OpenShift #OpenShiftAI #RedHatAI #CNCF #KServe #Inference #ModelServing

3 things to know about Red Hat AI 3

https://www.youtube.com/watch?v=eztORiJWYMs

#RedHat #AI #RedHatAI #llmd #Agentic #MCP #ModelContextProtocol #LlamaStack #OpenSource #OpenShift #OpenShiftAI

Red Hat OpenShift AI: Designed for FIPS, delivering trust and innovation

https://www.redhat.com/en/blog/red-hat-openshift-ai-designed-fips-delivering-trust-and-innovation

#RedHat #OpenShift #OpenShiftAI #AI #Kubernetes #InfoSec #FIPS

Red Hat Launches the llm-d Community, Powering Distributed Gen AI Inference at Scale

https://www.redhat.com/en/about/press-releases/red-hat-launches-llm-d-community-powering-distributed-gen-ai-inference-scale

#RedHat #CoreWeave #Google #IBM #NVIDIA #AMD #Cisco #HuggingFace #Intel #Lambda #Mistral #OpenSource #AI #llmd #vllm #Linux #Kubernetes

Achieve better large language model inference with fewer GPUs

"we achieved approximately 55-65% of the throughput on a server config that is approximately 15% of the cost"

https://www.redhat.com/en/blog/achieve-better-large-language-model-inference-fewer-gpus

#OpenShiftAI #RedHat #OpenShift #AI #Kubernetes #vllm #kubeflow #kserve

AI/ML Innovation in the Kubernetes Ecosystem

https://dzone.com/articles/ai-ml-innovation-in-the-kubernetes-ecosystem

#Kubernetes #OpenShift #AI #OpenShiftAI #RedHat #Kubeflow #Kserve #PyTorch #Ray #Feast #Jupyter

I'm just going to say it, and we can agree to disagree if you do in fact disagree...

systemd has categorically made Linux better in basically every way imaginable

It's earnestly cool if you don't agree but it's really really good

🤷

#systemd #linux #cgroups #init

Automatically decrypt your disk using TPM2

https://fedoramagazine.org/automatically-decrypt-your-disk-using-tpm2/

#Fedora #Linux #TPM #Security #InfoSec #Clevis

People out here sleepin' on mypyc.

http://mypyc.readthedocs.io/

#Python #mypy #mypyc