#redhatai — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #redhatai, aggregated by home.social.
-
Red Hat and Tesla engineers tackled a real production problem together.
3x output tokens/sec, 2x faster TTFT on Llama 3.1 70B with KServe + llm-d + vLLM. Fixes pushed upstream to KServe along the way.
This is what open source looks like. 🤝 🚀
https://llm-d.ai/blog/production-grade-llm-inference-at-scale-kserve-llm-d-vllm
#RedHat #Tesla #RedHatAI #vLLM #Pytorch #Kubernetes #OpenShift #KServe #llmd #Llama #OpenSource
-
233% 3-year return on investment and 13 months to payback with Red Hat AI
https://www.redhat.com/en/blog/233-3-year-return-investment-and-13-months-payback-red-hat-ai
#RedHat #AI #RedHatAI #OpenSource #OpenShift #RHEL #Kubernetes #vLLM
-
Today we announce the General Availability of AI Quickstarts! Get started quickly with your usecase and solve real business problems using Red Hat AI rapidly!
https://docs.redhat.com/en/learn/ai-quickstarts
#RedHat #AI #RedHatAI #OpenShift #OpenShiftAI #RHEL #RHELAI #OpenSource #OpenSourceAI
-
KServe joins CNCF as an incubating project
https://www.redhat.com/en/blog/kserve-joins-cncf-incubating-project
#RedHat #Kubernetes #OpenShift #OpenShiftAI #RedHatAI #CNCF #KServe #Inference #ModelServing
-
3 things to know about Red Hat AI 3
https://www.youtube.com/watch?v=eztORiJWYMs
#RedHat #AI #RedHatAI #llmd #Agentic #MCP #ModelContextProtocol #LlamaStack #OpenSource #OpenShift #OpenShiftAI
-
Red Hat Brings Distributed AI Inference to Production AI Workloads with Red Hat AI 3
-
Red Hat OpenShift AI achieves ISO 42001 AI certification, reinforcing Red Hat's leadership in responsible AI
https://www.redhat.com/en/blog/red-hat-openshift-ai-achieves-iso-42001-ai-certification