#redhatai — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #redhatai, aggregated by home.social.
-
RT @vllm_project: 🚀 Es freut mich zu sehen, dass @RedHatAI und das Team von @poolsideai zusammenarbeiten, um Laguna XS.2 in vLLM schneller und kostengünstiger bereitzustellen. Ein DFlash-Spezulator, der mit Speculators entwickelt wurde, entnimft 8 Tokens pro Vorwärtsdurchlauf, was zu einer 2- bis 3-fach schnelleren Dekodierung ohne Qualitätsverlust führt. LLM Compressor ermöglicht FP8-, NVFP4- und INT4-Checkpoints, sodass Sie Ihr Hardware-Budget optimal nutzen können. 🔗 vllm.ai/blog/2026-05-28-lagu… Red Hat AI (@RedHatAI) hat Laguna XS.2 von @poolsideai, ein 33B-MoE-Modell für agentic coding, trainiert. Red Hat AI hat einen DFlash-Spezulator dafür entwickelt: 0,6B Drafter, 8 Tokens pro Durchlauf, ohne Qualitätsverlust. FP8-, NVFP4- und INT4-Checkpoints über LLM Compressor. Modelle in den Kommentaren. Geschwindigkeitssteigerung mit @vllmproject: Video — https://nitter.net/RedHatAI/status/2060714281717404005#m
mehr auf Arint.info
#AIOptimization #CodingAI #LLMCompressor #MachineLearning #RedHatAI #vLLM #arint_info
-
Red Hat and Tesla engineers tackled a real production problem together.
3x output tokens/sec, 2x faster TTFT on Llama 3.1 70B with KServe + llm-d + vLLM. Fixes pushed upstream to KServe along the way.
This is what open source looks like. 🤝 🚀
https://llm-d.ai/blog/production-grade-llm-inference-at-scale-kserve-llm-d-vllm
#RedHat #Tesla #RedHatAI #vLLM #Pytorch #Kubernetes #OpenShift #KServe #llmd #Llama #OpenSource
-
Red Hat and Tesla engineers tackled a real production problem together.
3x output tokens/sec, 2x faster TTFT on Llama 3.1 70B with KServe + llm-d + vLLM. Fixes pushed upstream to KServe along the way.
This is what open source looks like. 🤝 🚀
https://llm-d.ai/blog/production-grade-llm-inference-at-scale-kserve-llm-d-vllm
#RedHat #Tesla #RedHatAI #vLLM #Pytorch #Kubernetes #OpenShift #KServe #llmd #Llama #OpenSource
-
Red Hat and Tesla engineers tackled a real production problem together.
3x output tokens/sec, 2x faster TTFT on Llama 3.1 70B with KServe + llm-d + vLLM. Fixes pushed upstream to KServe along the way.
This is what open source looks like. 🤝 🚀
https://llm-d.ai/blog/production-grade-llm-inference-at-scale-kserve-llm-d-vllm
#RedHat #Tesla #RedHatAI #vLLM #Pytorch #Kubernetes #OpenShift #KServe #llmd #Llama #OpenSource
-
Red Hat and Tesla engineers tackled a real production problem together.
3x output tokens/sec, 2x faster TTFT on Llama 3.1 70B with KServe + llm-d + vLLM. Fixes pushed upstream to KServe along the way.
This is what open source looks like. 🤝 🚀
https://llm-d.ai/blog/production-grade-llm-inference-at-scale-kserve-llm-d-vllm
#RedHat #Tesla #RedHatAI #vLLM #Pytorch #Kubernetes #OpenShift #KServe #llmd #Llama #OpenSource
-
Red Hat and Tesla engineers tackled a real production problem together.
3x output tokens/sec, 2x faster TTFT on Llama 3.1 70B with KServe + llm-d + vLLM. Fixes pushed upstream to KServe along the way.
This is what open source looks like. 🤝 🚀
https://llm-d.ai/blog/production-grade-llm-inference-at-scale-kserve-llm-d-vllm
#RedHat #Tesla #RedHatAI #vLLM #Pytorch #Kubernetes #OpenShift #KServe #llmd #Llama #OpenSource
-
233% 3-year return on investment and 13 months to payback with Red Hat AI
https://www.redhat.com/en/blog/233-3-year-return-investment-and-13-months-payback-red-hat-ai
#RedHat #AI #RedHatAI #OpenSource #OpenShift #RHEL #Kubernetes #vLLM
-
233% 3-year return on investment and 13 months to payback with Red Hat AI
https://www.redhat.com/en/blog/233-3-year-return-investment-and-13-months-payback-red-hat-ai
#RedHat #AI #RedHatAI #OpenSource #OpenShift #RHEL #Kubernetes #vLLM
-
233% 3-year return on investment and 13 months to payback with Red Hat AI
https://www.redhat.com/en/blog/233-3-year-return-investment-and-13-months-payback-red-hat-ai
#RedHat #AI #RedHatAI #OpenSource #OpenShift #RHEL #Kubernetes #vLLM
-
233% 3-year return on investment and 13 months to payback with Red Hat AI
https://www.redhat.com/en/blog/233-3-year-return-investment-and-13-months-payback-red-hat-ai
#RedHat #AI #RedHatAI #OpenSource #OpenShift #RHEL #Kubernetes #vLLM
-
233% 3-year return on investment and 13 months to payback with Red Hat AI
https://www.redhat.com/en/blog/233-3-year-return-investment-and-13-months-payback-red-hat-ai
#RedHat #AI #RedHatAI #OpenSource #OpenShift #RHEL #Kubernetes #vLLM
-
Today we announce the General Availability of AI Quickstarts! Get started quickly with your usecase and solve real business problems using Red Hat AI rapidly!
https://docs.redhat.com/en/learn/ai-quickstarts
#RedHat #AI #RedHatAI #OpenShift #OpenShiftAI #RHEL #RHELAI #OpenSource #OpenSourceAI
-
Today we announce the General Availability of AI Quickstarts! Get started quickly with your usecase and solve real business problems using Red Hat AI rapidly!
https://docs.redhat.com/en/learn/ai-quickstarts
#RedHat #AI #RedHatAI #OpenShift #OpenShiftAI #RHEL #RHELAI #OpenSource #OpenSourceAI
-
Today we announce the General Availability of AI Quickstarts! Get started quickly with your usecase and solve real business problems using Red Hat AI rapidly!
https://docs.redhat.com/en/learn/ai-quickstarts
#RedHat #AI #RedHatAI #OpenShift #OpenShiftAI #RHEL #RHELAI #OpenSource #OpenSourceAI
-
Today we announce the General Availability of AI Quickstarts! Get started quickly with your usecase and solve real business problems using Red Hat AI rapidly!
https://docs.redhat.com/en/learn/ai-quickstarts
#RedHat #AI #RedHatAI #OpenShift #OpenShiftAI #RHEL #RHELAI #OpenSource #OpenSourceAI
-
Today we announce the General Availability of AI Quickstarts! Get started quickly with your usecase and solve real business problems using Red Hat AI rapidly!
https://docs.redhat.com/en/learn/ai-quickstarts
#RedHat #AI #RedHatAI #OpenShift #OpenShiftAI #RHEL #RHELAI #OpenSource #OpenSourceAI
-
KServe joins CNCF as an incubating project
https://www.redhat.com/en/blog/kserve-joins-cncf-incubating-project
#RedHat #Kubernetes #OpenShift #OpenShiftAI #RedHatAI #CNCF #KServe #Inference #ModelServing
-
KServe joins CNCF as an incubating project
https://www.redhat.com/en/blog/kserve-joins-cncf-incubating-project
#RedHat #Kubernetes #OpenShift #OpenShiftAI #RedHatAI #CNCF #KServe #Inference #ModelServing
-
KServe joins CNCF as an incubating project
https://www.redhat.com/en/blog/kserve-joins-cncf-incubating-project
#RedHat #Kubernetes #OpenShift #OpenShiftAI #RedHatAI #CNCF #KServe #Inference #ModelServing
-
KServe joins CNCF as an incubating project
https://www.redhat.com/en/blog/kserve-joins-cncf-incubating-project
#RedHat #Kubernetes #OpenShift #OpenShiftAI #RedHatAI #CNCF #KServe #Inference #ModelServing
-
KServe joins CNCF as an incubating project
https://www.redhat.com/en/blog/kserve-joins-cncf-incubating-project
#RedHat #Kubernetes #OpenShift #OpenShiftAI #RedHatAI #CNCF #KServe #Inference #ModelServing
-
3 things to know about Red Hat AI 3
https://www.youtube.com/watch?v=eztORiJWYMs
#RedHat #AI #RedHatAI #llmd #Agentic #MCP #ModelContextProtocol #LlamaStack #OpenSource #OpenShift #OpenShiftAI
-
3 things to know about Red Hat AI 3
https://www.youtube.com/watch?v=eztORiJWYMs
#RedHat #AI #RedHatAI #llmd #Agentic #MCP #ModelContextProtocol #LlamaStack #OpenSource #OpenShift #OpenShiftAI
-
Red Hat Brings Distributed AI Inference to Production AI Workloads with Red Hat AI 3
-
Red Hat Brings Distributed AI Inference to Production AI Workloads with Red Hat AI 3
-
Red Hat Brings Distributed AI Inference to Production AI Workloads with Red Hat AI 3
-
Red Hat Brings Distributed AI Inference to Production AI Workloads with Red Hat AI 3
-
Red Hat Brings Distributed AI Inference to Production AI Workloads with Red Hat AI 3
-
Red Hat OpenShift AI achieves ISO 42001 AI certification, reinforcing Red Hat's leadership in responsible AI
https://www.redhat.com/en/blog/red-hat-openshift-ai-achieves-iso-42001-ai-certification
-
Red Hat OpenShift AI achieves ISO 42001 AI certification, reinforcing Red Hat's leadership in responsible AI
https://www.redhat.com/en/blog/red-hat-openshift-ai-achieves-iso-42001-ai-certification
-
Red Hat OpenShift AI achieves ISO 42001 AI certification, reinforcing Red Hat's leadership in responsible AI
https://www.redhat.com/en/blog/red-hat-openshift-ai-achieves-iso-42001-ai-certification
-
Red Hat OpenShift AI achieves ISO 42001 AI certification, reinforcing Red Hat's leadership in responsible AI
https://www.redhat.com/en/blog/red-hat-openshift-ai-achieves-iso-42001-ai-certification
-
Red Hat OpenShift AI achieves ISO 42001 AI certification, reinforcing Red Hat's leadership in responsible AI
https://www.redhat.com/en/blog/red-hat-openshift-ai-achieves-iso-42001-ai-certification