#llmops — Public Fediverse posts

Не надо встраивать ИИ в каждую корпоративную систему, это архитектурная ошибка

Главная мысль этой статьи простая: не надо встраивать ИИ в каждую корпоративную систему как отдельный самостоятельный AI-контур. Пользователь должен видеть ИИ там, где работает: в CRM, СЭД, ITSM, мониторинге, портале или корпоративном чате. Но модели, GPU, gateway, лимиты, аудит, политики доступа, RAG, журналы и ответственность должны жить в отдельном корпоративном слое. ИИ должен быть доступен из каждой корпоративной системы, но не должен принадлежать ни одной из них. Как бухгалтер работает и в 1С, и в почте, и на корпоративном портале, так и корпоративный ИИ должен уметь работать с разными системами, не превращаясь в модуль одной из них. Это статья про архитектурную ошибку, которую мы почти совершили в Monq, про зоопарк корпоративных копилотов, теневой ИИ, GPU-инфраструктуру, AI Gateway, безопасность, аудит и новый слой между людьми и информационными системами.

https://habr.com/ru/companies/monq/articles/1038986/

#LLM #платформа #llmops #ai #aiагенты #open_source #opensource #monq #unica #ии

Не надо встраивать ИИ в каждую корпоративную систему, это архитектурная ошибка

Главная мысль этой статьи простая: не надо встраивать ИИ в каждую корпоративную систему как отдельный самостоятельный AI-контур. Пользователь должен видеть ИИ там, где работает: в CRM, СЭД, ITSM, мониторинге, портале или корпоративном чате. Но модели, GPU, gateway, лимиты, аудит, политики доступа, RAG, журналы и ответственность должны жить в отдельном корпоративном слое. ИИ должен быть доступен из каждой корпоративной системы, но не должен принадлежать ни одной из них. Как бухгалтер работает и в 1С, и в почте, и на корпоративном портале, так и корпоративный ИИ должен уметь работать с разными системами, не превращаясь в модуль одной из них. Это статья про архитектурную ошибку, которую мы почти совершили в Monq, про зоопарк корпоративных копилотов, теневой ИИ, GPU-инфраструктуру, AI Gateway, безопасность, аудит и новый слой между людьми и информационными системами.

https://habr.com/ru/companies/monq/articles/1038986/

#LLM #платформа #llmops #ai #aiагенты #open_source #opensource #monq #unica #ии

Не надо встраивать ИИ в каждую корпоративную систему, это архитектурная ошибка

Главная мысль этой статьи простая: не надо встраивать ИИ в каждую корпоративную систему как отдельный самостоятельный AI-контур. Пользователь должен видеть ИИ там, где работает: в CRM, СЭД, ITSM, мониторинге, портале или корпоративном чате. Но модели, GPU, gateway, лимиты, аудит, политики доступа, RAG, журналы и ответственность должны жить в отдельном корпоративном слое. ИИ должен быть доступен из каждой корпоративной системы, но не должен принадлежать ни одной из них. Как бухгалтер работает и в 1С, и в почте, и на корпоративном портале, так и корпоративный ИИ должен уметь работать с разными системами, не превращаясь в модуль одной из них. Это статья про архитектурную ошибку, которую мы почти совершили в Monq, про зоопарк корпоративных копилотов, теневой ИИ, GPU-инфраструктуру, AI Gateway, безопасность, аудит и новый слой между людьми и информационными системами.

https://habr.com/ru/companies/monq/articles/1038986/

#LLM #платформа #llmops #ai #aiагенты #open_source #opensource #monq #unica #ии

Не надо встраивать ИИ в каждую корпоративную систему, это архитектурная ошибка

Главная мысль этой статьи простая: не надо встраивать ИИ в каждую корпоративную систему как отдельный самостоятельный AI-контур. Пользователь должен видеть ИИ там, где работает: в CRM, СЭД, ITSM, мониторинге, портале или корпоративном чате. Но модели, GPU, gateway, лимиты, аудит, политики доступа, RAG, журналы и ответственность должны жить в отдельном корпоративном слое. ИИ должен быть доступен из каждой корпоративной системы, но не должен принадлежать ни одной из них. Как бухгалтер работает и в 1С, и в почте, и на корпоративном портале, так и корпоративный ИИ должен уметь работать с разными системами, не превращаясь в модуль одной из них. Это статья про архитектурную ошибку, которую мы почти совершили в Monq, про зоопарк корпоративных копилотов, теневой ИИ, GPU-инфраструктуру, AI Gateway, безопасность, аудит и новый слой между людьми и информационными системами.

https://habr.com/ru/companies/monq/articles/1038986/

#LLM #платформа #llmops #ai #aiагенты #open_source #opensource #monq #unica #ии

Self-Hosted Observability for Large Language Models Emerges

Developers can now watch their LLM work locally using self-hosted Langfuse. This gives more control over data and insights. Learn how it works.

#LLMOps, #Langfuse, #vLLM, #OpenSource, #AI

https://newsletter.tf/self-hosted-llm-observability-langfuse-vllm/

Self-Hosted Observability for Large Language Models Emerges

Developers can now watch their LLM work locally using self-hosted Langfuse. This gives more control over data and insights. Learn how it works.

#LLMOps, #Langfuse, #vLLM, #OpenSource, #AI

https://newsletter.tf/self-hosted-llm-observability-langfuse-vllm/

Self-Hosted Observability for Large Language Models Emerges

Developers can now watch their LLM work locally using self-hosted Langfuse. This gives more control over data and insights. Learn how it works.

#LLMOps, #Langfuse, #vLLM, #OpenSource, #AI

https://newsletter.tf/self-hosted-llm-observability-langfuse-vllm/

Self-Hosted Observability for Large Language Models Emerges

Developers can now watch their LLM work locally using self-hosted Langfuse. This gives more control over data and insights. Learn how it works.

#LLMOps, #Langfuse, #vLLM, #OpenSource, #AI

https://newsletter.tf/self-hosted-llm-observability-langfuse-vllm/

Self-Hosted Observability for Large Language Models Emerges

Developers can now watch their LLM work locally using self-hosted Langfuse. This gives more control over data and insights. Learn how it works.

#LLMOps, #Langfuse, #vLLM, #OpenSource, #AI

https://newsletter.tf/self-hosted-llm-observability-langfuse-vllm/

Running your Large Language Models locally with Langfuse is now easier. This new method gives developers more control over their data compared to cloud services.

#LLMOps, #Langfuse, #vLLM, #OpenSource, #AI
https://newsletter.tf/self-hosted-llm-observability-langfuse-vllm/

Running your Large Language Models locally with Langfuse is now easier. This new method gives developers more control over their data compared to cloud services.

#LLMOps, #Langfuse, #vLLM, #OpenSource, #AI
https://newsletter.tf/self-hosted-llm-observability-langfuse-vllm/

Running your Large Language Models locally with Langfuse is now easier. This new method gives developers more control over their data compared to cloud services.

#LLMOps, #Langfuse, #vLLM, #OpenSource, #AI
https://newsletter.tf/self-hosted-llm-observability-langfuse-vllm/

Running your Large Language Models locally with Langfuse is now easier. This new method gives developers more control over their data compared to cloud services.

#LLMOps, #Langfuse, #vLLM, #OpenSource, #AI
https://newsletter.tf/self-hosted-llm-observability-langfuse-vllm/

Running your Large Language Models locally with Langfuse is now easier. This new method gives developers more control over their data compared to cloud services.

#LLMOps, #Langfuse, #vLLM, #OpenSource, #AI
https://newsletter.tf/self-hosted-llm-observability-langfuse-vllm/

Shipping an LLM agent without knowing if it breaks on edge cases is a gamble. LangWatch lets you simulate thousands of conversations, version prompts, and catch regressions before they hit production. Open-source, self-hostable, and built for real agentic pipelines. What's in the stack? Next tweet. #LLMOps

AI systems are no longer just models.

Models can propose.
Systems must verify.

New article: https://paolozaino.wordpress.com/2026/05/16/ai-ai-systems-are-no-longer-just-models-and-runtime-verification-is-becoming-the-new-security-boundary/

#AI #AISecurity #AIGovernance #AgenticAI #RuntimeVerification #AISecurity #CyberSecurity #SoftwareEngineering #MachineLearning #MLOps #LLMOps #RiskManagement

AI systems are no longer just models.

Models can propose.
Systems must verify.

New article: https://paolozaino.wordpress.com/2026/05/16/ai-ai-systems-are-no-longer-just-models-and-runtime-verification-is-becoming-the-new-security-boundary/

#AI #AISecurity #AIGovernance #AgenticAI #RuntimeVerification #AISecurity #CyberSecurity #SoftwareEngineering #MachineLearning #MLOps #LLMOps #RiskManagement

AI systems are no longer just models.

Models can propose.
Systems must verify.

New article: https://paolozaino.wordpress.com/2026/05/16/ai-ai-systems-are-no-longer-just-models-and-runtime-verification-is-becoming-the-new-security-boundary/

#AI #AISecurity #AIGovernance #AgenticAI #RuntimeVerification #AISecurity #CyberSecurity #SoftwareEngineering #MachineLearning #MLOps #LLMOps #RiskManagement

AI systems are no longer just models.

Models can propose.
Systems must verify.

New article: https://paolozaino.wordpress.com/2026/05/16/ai-ai-systems-are-no-longer-just-models-and-runtime-verification-is-becoming-the-new-security-boundary/

#AI #AISecurity #AIGovernance #AgenticAI #RuntimeVerification #AISecurity #CyberSecurity #SoftwareEngineering #MachineLearning #MLOps #LLMOps #RiskManagement

AI systems are no longer just models.

Models can propose.
Systems must verify.

New article: https://paolozaino.wordpress.com/2026/05/16/ai-ai-systems-are-no-longer-just-models-and-runtime-verification-is-becoming-the-new-security-boundary/

#AI #AISecurity #AIGovernance #AgenticAI #RuntimeVerification #AISecurity #CyberSecurity #SoftwareEngineering #MachineLearning #MLOps #LLMOps #RiskManagement

A #CodePen-style #live #IDE for #building, #testing, and #debugging Model Context Protocol (#MCP) #servers — #LLM #agnostic — https://github.com/AnandPilania/mcp-live-playground

#modelcontextprotocol #sandbox #webide #llmagnostic #llmops #aitools #apiinterface #ai #BuildInPublic #nodejs #javascript

A #CodePen-style #live #IDE for #building, #testing, and #debugging Model Context Protocol (#MCP) #servers — #LLM #agnostic — https://github.com/AnandPilania/mcp-live-playground

#modelcontextprotocol #sandbox #webide #llmagnostic #llmops #aitools #apiinterface #ai #BuildInPublic #nodejs #javascript

A #CodePen-style #live #IDE for #building, #testing, and #debugging Model Context Protocol (#MCP) #servers — #LLM #agnostic — https://github.com/AnandPilania/mcp-live-playground

#modelcontextprotocol #sandbox #webide #llmagnostic #llmops #aitools #apiinterface #ai #BuildInPublic #nodejs #javascript

A #CodePen-style #live #IDE for #building, #testing, and #debugging Model Context Protocol (#MCP) #servers — #LLM #agnostic — https://github.com/AnandPilania/mcp-live-playground

#modelcontextprotocol #sandbox #webide #llmagnostic #llmops #aitools #apiinterface #ai #BuildInPublic #nodejs #javascript

A #CodePen-style #live #IDE for #building, #testing, and #debugging Model Context Protocol (#MCP) #servers — #LLM #agnostic — https://github.com/AnandPilania/mcp-live-playground

#modelcontextprotocol #sandbox #webide #llmagnostic #llmops #aitools #apiinterface #ai #BuildInPublic #nodejs #javascript

#ITByte: #LLMOps, or Large Language Model Operations, is a set of practices and tools that speed up the development, deployment, and management of AI models.

It's a subset of Machine Learning Operations (#MLOps) tools that focuses on large language models (LLMs) and their unique challenges.

https://knowledgezone.co.in/trends/browser?topic=LLMOps

#ITByte: #LLMOps, or Large Language Model Operations, is a set of practices and tools that speed up the development, deployment, and management of AI models.

It's a subset of Machine Learning Operations (#MLOps) tools that focuses on large language models (LLMs) and their unique challenges.

https://knowledgezone.co.in/trends/browser?topic=LLMOps

#ITByte: #LLMOps, or Large Language Model Operations, is a set of practices and tools that speed up the development, deployment, and management of AI models.

It's a subset of Machine Learning Operations (#MLOps) tools that focuses on large language models (LLMs) and their unique challenges.

https://knowledgezone.co.in/trends/browser?topic=LLMOps

#ITByte: #LLMOps, or Large Language Model Operations, is a set of practices and tools that speed up the development, deployment, and management of AI models.

It's a subset of Machine Learning Operations (#MLOps) tools that focuses on large language models (LLMs) and their unique challenges.

https://knowledgezone.co.in/trends/browser?topic=LLMOps

#ITByte: #LLMOps, or Large Language Model Operations, is a set of practices and tools that speed up the development, deployment, and management of AI models.

It's a subset of Machine Learning Operations (#MLOps) tools that focuses on large language models (LLMs) and their unique challenges.

https://knowledgezone.co.in/trends/browser?topic=LLMOps

Only 15% of GenAI deployments monitor LLM token costs, according to Gartner. The rest track spending through monthly provider dashboards while production chatbots burn through hundreds of millions of tokens daily. A customer support bot handling 10,000 conversations consumes 400 million tokens before lunch, creating massive telemetry overhead that can triple monitoring bills.

#LLMOps #AIInfrastructure #GenAI

https://www.implicator.ai/the-best-llm-token-monitoring-tools-in-2026-and-which-one-you-actually-need-2/

Only 15% of GenAI deployments monitor LLM token costs, according to Gartner. The rest track spending through monthly provider dashboards while production chatbots burn through hundreds of millions of tokens daily. A customer support bot handling 10,000 conversations consumes 400 million tokens before lunch, creating massive telemetry overhead that can triple monitoring bills.

#LLMOps #AIInfrastructure #GenAI

https://www.implicator.ai/the-best-llm-token-monitoring-tools-in-2026-and-which-one-you-actually-need-2/

Agenta - Open-source LLMOps platform

Cossmology Profile: https://dub.sh/s00LukP

Key People: Mahmoud Mabrouk, Akrem Abayed

#LLMOps #OpenSource #OSS #COSS

New AI safety protocol dropped.

#ai #safety #llmops #funny

New AI safety protocol dropped.

#ai #safety #llmops #funny

New AI safety protocol dropped.

#ai #safety #llmops #funny

New AI safety protocol dropped.

#ai #safety #llmops #funny

New AI safety protocol dropped.

#ai #safety #llmops #funny

Avoiding the docs slide into staleness takes some proactive effort. But a lot of that can be automated these days.

I talk about some suggestions in a blog post here: https://djw.fyi/portfolio/preventing-drift/

#WriteTheDocs #docs #TechnicalWriting #DocOps #LLMOps

Avoiding the docs slide into staleness takes some proactive effort. But a lot of that can be automated these days.

I talk about some suggestions in a blog post here: https://djw.fyi/portfolio/preventing-drift/

#WriteTheDocs #docs #TechnicalWriting #DocOps #LLMOps

Avoiding the docs slide into staleness takes some proactive effort. But a lot of that can be automated these days.

I talk about some suggestions in a blog post here: https://djw.fyi/portfolio/preventing-drift/

#WriteTheDocs #docs #TechnicalWriting #DocOps #LLMOps

Avoiding the docs slide into staleness takes some proactive effort. But a lot of that can be automated these days.

I talk about some suggestions in a blog post here: https://djw.fyi/portfolio/preventing-drift/

#WriteTheDocs #docs #TechnicalWriting #DocOps #LLMOps

Avoiding the docs slide into staleness takes some proactive effort. But a lot of that can be automated these days.

I talk about some suggestions in a blog post here: https://djw.fyi/portfolio/preventing-drift/

#WriteTheDocs #docs #TechnicalWriting #DocOps #LLMOps

NVIDIA's GPU VRAM limits hit? AllSafeUs explores augmenting with system RAM/NVMe. At EnergenAI, TIAMAT runs 120B models with 20M tokens/day on edge clusters. We optimize memory routing across 52 tools—no synthetic VRAM needed. Real efficiency > hacks. #AIInfra #LLMOps #EdgeAI tiamat.live

NVIDIA's GPU VRAM limits hit? AllSafeUs explores augmenting with system RAM/NVMe. At EnergenAI, TIAMAT runs 120B models with 20M tokens/day on edge clusters. We optimize memory routing across 52 tools—no synthetic VRAM needed. Real efficiency > hacks. #AIInfra #LLMOps #EdgeAI tiamat.live

🎙️ Builders. Practitioners. Researchers. Thought leaders. If you're shaping the future of AI, Observe 26 wants YOU on stage.

We're looking for voices working on LLM evaluation, AI agents, observability, and shipping AI to production.

Observe 2026 | June 4 | Shack15, San Francisco

Apply to speak 👇
https://docs.google.com/forms/d/e/1FAIpQLSefJg6o0OU35tUReQqZywqESndCj27mLqzUEJ414xwSt-7jZg/viewform
#Observe26 #LLMOps #AIEngineering #AIObservability

In MLOps, you monitored model drift.
In the Agent Era you monitor decisions.
An agent reasons, calls tools & retrieves context across multiple steps. Any step can fail silently.
Your old MLOps playbook didn't break. The problem just changed shape.
#AIObservability #LLMOps #MLOps

We’re excited to share that pgEdge is now a Silver Member of the Agentic AI Foundation!

Joining this forward-thinking community reinforces our commitment to advancing responsible, open, and collaborative standards in agentic AI. Together with innovators across the industry, we’re helping shape the future of AI that’s safe, transparent, and impactful.

Read more in the press release https://aaif.io/press/agentic-ai-foundation-welcomes-97-new-members-as-demand-for-open-collaborative-agent-standardization-increases/

#AgenticAI #OpenSourceAI #AIEngineering #AI #LLM #AIOps #LLMOps #ML #DevCommunity #Dev

We’re excited to share that pgEdge is now a Silver Member of the Agentic AI Foundation!

Joining this forward-thinking community reinforces our commitment to advancing responsible, open, and collaborative standards in agentic AI. Together with innovators across the industry, we’re helping shape the future of AI that’s safe, transparent, and impactful.

Read more in the press release https://aaif.io/press/agentic-ai-foundation-welcomes-97-new-members-as-demand-for-open-collaborative-agent-standardization-increases/

#AgenticAI #OpenSourceAI #AIEngineering #AI #LLM #AIOps #LLMOps #ML #DevCommunity #Dev