#redhatai — Public Fediverse posts

Red Hat and Tesla engineers tackled a real production problem together.

3x output tokens/sec, 2x faster TTFT on Llama 3.1 70B with KServe + llm-d + vLLM. Fixes pushed upstream to KServe along the way.

This is what open source looks like. 🤝 🚀

https://llm-d.ai/blog/production-grade-llm-inference-at-scale-kserve-llm-d-vllm

#RedHat #Tesla #RedHatAI #vLLM #Pytorch #Kubernetes #OpenShift #KServe #llmd #Llama #OpenSource

Red Hat and Tesla engineers tackled a real production problem together.

3x output tokens/sec, 2x faster TTFT on Llama 3.1 70B with KServe + llm-d + vLLM. Fixes pushed upstream to KServe along the way.

This is what open source looks like. 🤝 🚀

https://llm-d.ai/blog/production-grade-llm-inference-at-scale-kserve-llm-d-vllm

#RedHat #Tesla #RedHatAI #vLLM #Pytorch #Kubernetes #OpenShift #KServe #llmd #Llama #OpenSource

Red Hat and Tesla engineers tackled a real production problem together.

3x output tokens/sec, 2x faster TTFT on Llama 3.1 70B with KServe + llm-d + vLLM. Fixes pushed upstream to KServe along the way.

This is what open source looks like. 🤝 🚀

https://llm-d.ai/blog/production-grade-llm-inference-at-scale-kserve-llm-d-vllm

#RedHat #Tesla #RedHatAI #vLLM #Pytorch #Kubernetes #OpenShift #KServe #llmd #Llama #OpenSource

Red Hat and Tesla engineers tackled a real production problem together.

3x output tokens/sec, 2x faster TTFT on Llama 3.1 70B with KServe + llm-d + vLLM. Fixes pushed upstream to KServe along the way.

This is what open source looks like. 🤝 🚀

https://llm-d.ai/blog/production-grade-llm-inference-at-scale-kserve-llm-d-vllm

#RedHat #Tesla #RedHatAI #vLLM #Pytorch #Kubernetes #OpenShift #KServe #llmd #Llama #OpenSource

Red Hat and Tesla engineers tackled a real production problem together.

3x output tokens/sec, 2x faster TTFT on Llama 3.1 70B with KServe + llm-d + vLLM. Fixes pushed upstream to KServe along the way.

This is what open source looks like. 🤝 🚀

https://llm-d.ai/blog/production-grade-llm-inference-at-scale-kserve-llm-d-vllm

#RedHat #Tesla #RedHatAI #vLLM #Pytorch #Kubernetes #OpenShift #KServe #llmd #Llama #OpenSource

233% 3-year return on investment and 13 months to payback with Red Hat AI

https://www.redhat.com/en/blog/233-3-year-return-investment-and-13-months-payback-red-hat-ai

#RedHat #AI #RedHatAI #OpenSource #OpenShift #RHEL #Kubernetes #vLLM

233% 3-year return on investment and 13 months to payback with Red Hat AI

https://www.redhat.com/en/blog/233-3-year-return-investment-and-13-months-payback-red-hat-ai

#RedHat #AI #RedHatAI #OpenSource #OpenShift #RHEL #Kubernetes #vLLM

233% 3-year return on investment and 13 months to payback with Red Hat AI

https://www.redhat.com/en/blog/233-3-year-return-investment-and-13-months-payback-red-hat-ai

#RedHat #AI #RedHatAI #OpenSource #OpenShift #RHEL #Kubernetes #vLLM

233% 3-year return on investment and 13 months to payback with Red Hat AI

https://www.redhat.com/en/blog/233-3-year-return-investment-and-13-months-payback-red-hat-ai

#RedHat #AI #RedHatAI #OpenSource #OpenShift #RHEL #Kubernetes #vLLM

233% 3-year return on investment and 13 months to payback with Red Hat AI

https://www.redhat.com/en/blog/233-3-year-return-investment-and-13-months-payback-red-hat-ai

#RedHat #AI #RedHatAI #OpenSource #OpenShift #RHEL #Kubernetes #vLLM

Today we announce the General Availability of AI Quickstarts! Get started quickly with your usecase and solve real business problems using Red Hat AI rapidly!

https://docs.redhat.com/en/learn/ai-quickstarts

#RedHat #AI #RedHatAI #OpenShift #OpenShiftAI #RHEL #RHELAI #OpenSource #OpenSourceAI

Red Hat AI 3 is GA!

https://docs.redhat.com/en/documentation/red_hat_ai/3

#RedHat #RedHatAI #RHAIIS #OpenShift #OpenShiftAI #vLLM #KServe #Kubeflow #llmd #AI #GenAI #AIPlatform #OpenSource #OpenSourceAI

KServe joins CNCF as an incubating project

https://www.redhat.com/en/blog/kserve-joins-cncf-incubating-project

#RedHat #Kubernetes #OpenShift #OpenShiftAI #RedHatAI #CNCF #KServe #Inference #ModelServing

3 things to know about Red Hat AI 3

https://www.youtube.com/watch?v=eztORiJWYMs

#RedHat #AI #RedHatAI #llmd #Agentic #MCP #ModelContextProtocol #LlamaStack #OpenSource #OpenShift #OpenShiftAI

Red Hat Brings Distributed AI Inference to Production AI Workloads with Red Hat AI 3

https://www.redhat.com/en/about/press-releases/red-hat-brings-distributed-ai-inference-production-ai-workloads-red-hat-ai-3

#RedHat #AI #OpenSource #RedHatAI #vllm #llamastack #mcp

Red Hat OpenShift AI achieves ISO 42001 AI certification, reinforcing Red Hat's leadership in responsible AI

https://www.redhat.com/en/blog/red-hat-openshift-ai-achieves-iso-42001-ai-certification

#RedHat #OpenShift #AI #OpenShiftAI #RedHatAI