home.social

#deep-seek — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #deep-seek, aggregated by home.social.

fetched live
  1. Die US-Regierung wirft DeepSeek aus allen zivilen Bundesbehörden. Der Wortlaut könnte sogar Produkte erfassen, die mit DeepSeek entwickelt wurden.

    Was heißt das für Teams in Europa, die DeepSeek-Modelle selbst hosten? Wir ordnen ein.

    #KI #DeepSeek #SelfHosting #OpenWeights

    kiberblick.de/aktuell/2026/202

  2. DeepSeek has raised about ¥100 billion (US$15 billion) in its latest fundraising round, one of China's largest ever. Investors include CATL and Tencent.

    Source: Free Malaysia Today
    freemalaysiatoday.com/category

    #Startups #DeepSeek #Tencent

  3. Запускаем локальные альтернативы ChatGPT и Claude: пять открытых ИИ-моделей для GPU 8–32 ГБ

    В сентябре появились новые, более мощные модели: Claude Fable 5.1, GPT-6 Astra, Gemini 3.8 Flash. Однако использовать эти модели становится всё сложнее — из-за сокращающихся лимитов подписок, роста стоимости (уже есть подписка по 500 долларов в месяц!) и внезапных блокировок аккаунтов. Альтернатива — открытые модели, которые можно развернуть на своем оборудовании или арендованном сервере. Для части из них достаточно обычной RTX с 8–12 ГБ видеопамяти; для более крупных можно использовать GPU с 24–32 ГБ. Мы выбрали несколько таких моделей, включая новинки последних месяцев, чтобы разобрать, на что они способны и какие задачи могут решать.

    habr.com/ru/companies/mclouds/

    #нейросети #gpt #mimo #иимодель #ииассистент #gemma #qwen #ииагенты #deepseek #локальные_модели

  4. RT @Hesamation: „Wir haben festgestellt, dass DeepSeek V4.1 Flash 1017 unsere mehrstufige offensive Cybersecurity-Aufgabe besser bewältigt als GPT 6 Sol.“

    mehr auf Arint.info

    #AI #Cybersecurity #DeepSeek #GPT6 #OpenSource #Technologie #arint_info

    https://x.com/Hesamation/status/2112474544237642176

  5. DeepSeek has reportedly raised $15 billion, days after the US ordered agencies to rip it out
    DeepSeek has raised about 100 billion yuan ($15 billion), Bloomberg reports, with Tencent and battery maker CATL among the biggest investors.

    #DeepSeek #Tencent #AI

    madrobot.blog/2026/10/22/deeps

  6. #DeepInfer #opensources #DeepSeek’s #inferenceengine under Apache 2.0, enabling V4.1 Flash self-hosting with internal optimisations. Huawei Ascend 950 NPU and Nvidia SM100 are supported, though full production components remain absent. thenewstack.io/deepseek-deepin #tech #news #ainews

  7. 📢 Le DHS interdit DeepSeek dans les agences fédérales civiles américaines pour raisons de sécurité nationale

    Cet article rapporte la décision officielle du Department of Homeland Security (DHS) d'interdire l'utilisation du modèle d'IA chinois DeepSeek et de ses affiliés au sein des agences fédérales civiles américaines. La notice, publiée au…

    📖 cyberveille : cyberveille.ch/posts/2026-10-2
    🌐 source : cyberscoop.com/dhs-bans-deepse
    🟡 vérification factuelle moyenne
    #DeepSeek #SécuritéNationale #Cyberveille

  8. Engadget: Homeland Security bans DeepSeek use in federal civilian agencies . “The Department of Homeland Security has issued a sweeping restriction to remove DeepSeek use across all federal civilian agencies and their IT systems. In a notice published with the Federal Register, DHS characterized the risks of DeepSeek use as potentially resulting in the “transfer of sensitive data” of US […]

    https://rbfirehose.com/2026/10/21/engadget-homeland-security-bans-deepseek-use-in-federal-civilian-agencies/
  9. DeepSeek x Gigantes: A Revolução do Livre Mercado na IA

    🚨 A DeepSeek acabou de chacoalhar o mercado de IA! 🚨

    Você está vendo o que está acontecendo? Enquanto OpenAI e Anthropic se preparam para IPOs e cobram os olhos da cara, a DeepSeek lança uma IA mais rápida, mais inteligente e mais barata. E não para por aí...

    🔥 O que a DeepSeek fez:
    • Lançou uma IA de alta performance com custo...

    #InteligenciaArtificial #DeepSeek #LivreMercado #OpenAI #Anthropic #Tecnologia #Inovacao #MorningCrypto

  10. US Orders Federal Agencies to Remove DeepSeek as Company Open-Sources Its AI Serving Tools

    DHS directs federal agencies to drop DeepSeek technology, including third-party products built on its models, while DeepSeek releases DeepInfer for public use.

    newisty.com/blog/us-orders-fed

    #deepseek #ai #regulation

  11. DHS directed US federal civilian agencies to remove DeepSeek AI products, including third-party integrations, from IT systems. It signals widening supply-chain risk controls around foreign AI models in government environments. #DeepSeek #SupplyChainSecurity #AIGovernance

    cyberworldops.eu/en/us-orders-

  12. The U.S.

    Department of Homeland Security has ordered federal civilian agencies to remove DeepSeek products from their IT systems.

    The directive, issued under the Federal Acquisition Supply Chain Security Act, also bans agencies and contractors from purchasing new products or services from Hangzhou DeepSeek Artificial Intelligence Co.

    Government contractors must check compliance registries and report covered item…

    en.hacks.gr/oi-inomenes-polite

    #DeepSeek #ArtificialIntelligence #SupplyChain #Policy

  13. my take: the ban stops agencies from using deepseek. it doesn't stop anyone from learning how deepseek serves models this cheap

    that recipe is public now, and every inference team will read it

    would you run it?

    #AI #OpenSource #DeepSeek #LLM #MLOps

  14. [recovery mode] Подписка или API: расчёт стоимости текстового конвейера и агента

    Подписка ChatGPT или Claude стоит 20 долларов в месяц, а агент на ней за день съедает токенов на сумму, которую по API пришлось бы платить неделями. Поэтому всё больше людей запускают свои скрипты и сервисы на подписке, а не на API-ключе. Разобрал по документам и истории 2026 года, что разрешено, как устроены лимиты, за что уже банили, сколько это стоит на самом деле и как собрать автоматизацию так, чтобы она не умерла от первого изменения правил. Данные на 21 октября 2026 года.

    habr.com/ru/articles/1097104/

    #автоматизация #api #лимиты #codex #deepseek #claude_code #agent_sdk #claude_p #подписка_chatgpt #codex_exec

  15. DeepSeek released DeepInfer on October 20, an inference framework supporting Nvidia and Huawei chips.

    Source: TechNode
    technode.com/2026/10/21/deepse

    #AI #DeepSeek #Nvidia

  16. USA verbannen DeepSeek aus allen zivilen Bundesbehörden

    Das US-Heimatschutzministerium verbietet zivilen Bundesbehörden alle DeepSeek-Produkte. Die weit gefasste Anordnung wirft Fragen zur praktischen Umsetzung auf.

    Zum Artikel auf heise.de

    #deepseek #usa #künstlicheintelligenz #china #netzpolitik

  17. DeepSeek has fully open-sourced its inference framework, DeepInfer, to run AI models efficiently on Nvidia Blackwell GPUs and Huawei hardware.

    Source: South China Morning Post
    scmp.com/tech/big-tech/article

    #Tech #DeepSeek #Nvidia

  18. ReAct-агент изнутри. Модель, инструменты и управляющий цикл

    Как запрос языковой модели превращается в чтение файла или запуск команды? Разберем устройство ReAct-агента: кто выбирает действие, кто выполняет инструмент и как результат попадает в следующий запрос. Сначала посмотрим на схемы обмена, затем - на реализацию цикла на Python без агентных фреймворков. Код примера доступен на GitHub.

    habr.com/ru/articles/1096976/

    #python #react #llm #aiагенты #deepseek #tool_calling #агентный_цикл

  19. FYI: DeepSeek sets a $0.75 web search price as Cloudflare grades bots on conduct: DeepSeek priced agent web search at $0.75 per 1,000 calls from October 31, 2026, as Cloudflare began scoring Verified bots on whether they obey site rules. ppc.land/deepseek-sets-a-0-75- #DeepSeek #Cloudflare #WebSearch #PriceStrategy #Bots

  20. Inférence IA : DeepSeek libère son moteur secret pour casser les prix du cloud

    Faire tourner des modèles géants sans exploser la facture cloud ? L'entreprise chinoise DeepSeek vient de publier en open source DeepInfer, son propre framework d'inférence sous licence Apache 2.0. Une brique taillée pour l'auto-hébergement 👇

    goodtech.info/deepseek-deepinf

  21. Nexus-CLI – Pure Go Bridge to DeepSeek R1/V3 with Claude Code and Ollama Support

    github.com/xamrayev/nexus-cli

    #claude #deepseek #github

  22. RT @PawelHuryn: Ich habe den DeepSeek V4.1 Flash 1017-Benchmark 89-mal über 9 verschiedene Harnesses wiederholt, um zu verstehen, welcher am besten funktioniert.

    mehr auf Arint.info

    #AI #Benchmarking #CodeGeneration #DeepSeek #Performance #arint_info

    https://x.com/PawelHuryn/status/2112571119412646370

  23. The U.S.

    Department of Homeland Security has ordered federal civilian agencies to halt purchases and remove DeepSeek products and services from government IT systems.

    The restriction spans both direct DeepSeek technology and third-party systems built using its tools, subject to formal agency exceptions.

    The directive follows broader concerns regarding data access under Chinese law and prior reports involving model di…

    en.hacks.gr/oi-ipa-apagoreyoyn

    #DeepSeek #ArtificialIntelligence #Regulation #US

  24. EEUU prohíbe el uso de DeepSeek en sistemas gubernamentales por riesgos de seguridad

    📰 Título original: EEUU ordena a agencias federales eliminar DeepSeek – El Ecosistema Startup

    🤖 IA: No es clickbait ✅
    👥 Usuarios: No es clickbait ✅

    👇👇👇 es.killbait.com/eeuu-prohibe-e

    #inteligenciaartificial #deepseek

  25. FYI: DeepSeek prices web search for AI agents at $0.75 per 1,000 calls: Search and Fetch each allow 5 requests per second per account. Claude Code and Codex tool calls stay free until October 31 - what changes once billing begins? ppc.land/deepseek-prices-web-s #DeepSeek #AI #WebSearch #Pricing #ArtificialIntelligence

  26. Společnost DeepSeek zveřejnila na GitHubu pod licencí Apache 2.0 projekt DeepInfer. Podle popisu jde o výkonný framework pro velkoškálovou inferenci, který pohání produkční služby DeepSeeku. Open source verze ale nabízí jen offline inferenci s klíčovými funkcemi potřebnými pro nasazení ve velkém. Podporovaným modelem je zatím DeepSeek-V4.1-Flash, výchozí checkpoint se […]

    https://zdrojak.cz/zpravicky/deepseek-zverejnil-deepinfer-inferencni-framework-pro-sve-modely/
  27. 🦅 DeepSeek banned from US government in race with China for AI dominance - BBC

    「 The Department of Homeland Security (DHS) has banned all use of DeepSeek within civilian government agencies, and any technology built with the aid of its AI models.
    As a powerful AI model that is open source - meaning it is free to access and less expensive to use - DeepSeek has been seen as a disruptive force in the ongoing AI technology race 」

    bbc.com/news/articles/cjkgeq0k

    #deepseek #china #geopol #tradewar #ai

  28. Yhdysvallat on kieltänyt kiinalaisen DeepSeek -tekoälyn käytön

    Kielto koskee kaikkia liittovaltion virastoja, mutta ei ulotu yksityisiin yrityksiin tai sovelluskehittäjiin.

    dawn.fi/uutiset/2026/10/20/yhd

    #deepseek #yhdysvallat #kiina #tekoäly #ai #uutiset #teknologia #tekniikka

  29. DeepSeek Opens Its Inference Engine to the World – What the Numbers Really Mean

    The Lead


    DeepSeek just gave developers the keys to run a 67 B model on a single‑node GPU cluster. The claim sparked a flurry of headlines positioning the release as a direct challenge to proprietary stacks such as OpenAI’s hosted API or NVIDIA’s TensorRT‑LLM.

    Two weeks later the GitHub repository deepseekai/deepinfer went public, complete with an MIT‑style license, Docker images on Hugging Face, and a Python toolkit for model conversion. The community now holds the same low‑level kernels that DeepSeek uses internally, and the first benchmark data are already circulating on Reddit’s r/MachineLearning and Hacker News.

    But hype does not equal impact. The real question is whether DeepInfer delivers measurable advantages over existing open‑source runtimes, and whether those advantages survive the inevitable trade‑offs of openness, community support, and regulatory pressure. This article dissects the launch, walks through a concrete deployment scenario, drills into the benchmark tables, and evaluates the risks that could temper the engine’s long‑term relevance.

    Case Study: Deploying a Real‑Time Customer‑Support Bot


    Background – A mid‑size e‑commerce firm wants to replace its rule‑based FAQ system with an LLM‑powered chatbot. Its private data‑center houses two NVIDIA A100 40 GB GPUs and several RTX 4090 cards for burst workloads.

    Step 1 – Model Selection


    The engineering team picks DeepSeek‑R1‑7B, a model that balances instruction‑following ability with a modest memory footprint. After downloading the model from Hugging Face, they run the deepseek‑infer‑toolkit to convert the weights into DeepInfer’s custom checkpoint format. The conversion finishes in three minutes, thanks to a zero‑copy loader that maps the binary directly into GPU memory without an intermediate CPU staging area.

    Step 2 – Quantization


    To fit the model onto a single RTX 4090, the team applies the built‑in INT8 post‑training quantizer. The toolkit reports a 0.4 % drop in Winogrande accuracy—a trade‑off the product manager deems acceptable for a 2× speed boost.

    Step 3 – Service Definition


    Using the DeepInfer CLI, the engineers spin up a REST endpoint that streams tokens as they are generated. They enable the dynamic scheduler’s per‑token micro‑batching feature, which keeps the GPU busy even when the chatbot receives isolated single‑user queries.

    Step 4 – Load Test


    A synthetic load generator sends 1,000 concurrent chat sessions, each consisting of a 20‑token prompt followed by a 60‑token response. The DeepInfer metrics dashboard shows an average throughput of 210 tokens / s and a 90‑percentile latency of 5 ms per token on the RTX 4090. By contrast, a comparable deployment that uses vLLM on the same hardware stalls at 135 tokens / s and 12 ms latency.

    Step 5 – Production Rollout


    The team integrates a retrieval plugin that pulls product descriptions from a vector store. The end‑to‑end latency climbs to 12 ms per token, still well below the 30 ms threshold that UX designers set for a “smooth” chat experience.

    Result – The entire pipeline—from model download to a production‑grade service—takes under an hour, a dramatic improvement over the multi‑day setup the team previously endured with a proprietary stack.

    The Meat (Hard Numbers)


    The benchmark suite released alongside DeepInfer paints a consistent picture: the engine extracts 30 %–55 % more throughput than the most popular open‑source alternatives while keeping memory consumption in check.

    “DeepInfer’s FP8 kernels push the 67 B model to 15 tokens / s on a 4‑GPU A100 node, a 45 % gain over FasterTransformer.” – DeepSeek internal brief (Oct 2026)
    BenchmarkModelHWConfigThroughput (t/s)90 % LatencyMem (GB)Gain vs. CompetitorBaseDeepSeek‑R1‑7B1 × A100 40 GBFP161208 ms12+30 % vs. vLLM (92)FP8 QuantDeepSeek‑V3‑67B4 × A100 80 GBFP81568 ms42+45 % vs. FasterTransformer (≈10)INT8DeepSeek‑R1‑7B2 × RTX 4090INT82105 ms7+55 % vs. TensorRT‑LLM (135)Batch‑1 ChatDeepSeek‑R1‑7B + Retrieval1 × A100FP16 + plugin9512 ms14Comparable to OpenAI gpt‑3.5‑turbo on same HWVision‑LanguageDeepSeek‑VL‑13B4 × A100FP169 (image‑text)110 ms36First open‑source VL model under 150 ms on 4‑GPU node

    How DeepInfer Pulls Ahead

    TechniqueWhat DeepInfer DoesWhy It MattersCustom FP8 kernelsExecutes attention and feed‑forward layers directly on 8‑bit mantissas, eliminating the de‑quant‑re‑quant loop that generic runtimes insert.Cuts memory‑bandwidth demand, enabling larger models on the same GPU bus.Dynamic per‑token schedulerSplits each incoming request into micro‑batches, redistributes work across GPUs in real time, and back‑pressures the client when queues grow.Keeps GPU utilization above 95 % even for batch‑size‑1 inference, the common case for chat and retrieval‑augmented generation.Zero‑copy model loaderMaps the on‑disk checkpoint into GPU address space via mmap, then patches pointers in‑place.Reduces cold‑start latency from ~30 s to < 5 s for the 67 B checkpoint, a critical factor for serverless deployments.Quant‑aware runtime APILets the caller request mixed‑precision (e.g., FP8 for attention, INT8 for MLP) per layer.Gives developers fine‑grained control over speed‑accuracy trade‑offs without recompiling the engine.Built‑in retrieval pluginProvides a gRPC‑compatible interface to dense vector stores, automatically batching lookups with token generation.Enables end‑to‑end latency measurement that includes knowledge‑base access, a scenario most benchmarks ignore.


    These engineering choices explain why DeepInfer outperforms vLLM, FasterTransformer, and TensorRT‑LLM on the same hardware. The engine does not rely on vendor‑specific libraries alone; instead, DeepSeek engineers wrote bespoke kernels that expose the same low‑level primitives that power DeepSeek’s internal serving stack.

    Risks (Pivot)

    1. Community Momentum vs. Corporate Stewardship


    Open‑source projects thrive on contributions, but DeepInfer’s codebase is still thinly populated. As of the July 2024 release, the GitHub repo shows 12 contributors and ≈ 2 k commits. In contrast, vLLM boasts > 150 contributors and a weekly release cadence. If DeepSeek scales back its internal commitment—perhaps to focus on the upcoming DeepInfer‑X distributed layer—external contributors may lose the incentive to maintain the core kernels.

    Mitigation: A $250 k hackathon fund and a “co‑author” CLA aim to seed a contributor ecosystem, but the real test will be whether community‑driven PRs address edge‑case bugs (e.g., mixed‑precision overflow on older GPUs) faster than DeepSeek can respond.

    2. Regulatory Headwinds


    The launch coincided with a U.S. export‑control ban that restricts the distribution of certain LLM weights. DeepInfer sidesteps the ban by exposing only the inference stack, not the model parameters themselves. However, the engine’s ability to load any model—including those subject to export controls—means downstream users could inadvertently violate regulations.

    Mitigation: DeepSeek includes a “model‑signature verification” step that validates a model’s provenance, but enterprises must implement their own compliance workflows, adding operational overhead.

    3. Performance Saturation on Older Hardware


    Benchmarks highlight impressive gains on A100 and RTX 4090 GPUs, but many production clusters still run on older V100 or even CPU‑only nodes. DeepInfer’s FP8 kernels rely on Tensor Core support introduced in the Ampere architecture; on V100 the engine falls back to FP16 kernels, erasing most of the speed advantage.

    Mitigation: The roadmap mentions a “fallback layer” that will map FP8 operations to emulated FP16 on legacy GPUs, but this feature remains in prototype stage. Users with heterogeneous fleets may need to maintain two separate inference stacks, increasing operational complexity.

    4. Vendor Lock‑in Through CUDA Extensions


    DeepInfer’s custom kernels compile against a specific CUDA toolkit version (12.3 at launch). Upgrading to newer driver releases or switching to AMD GPUs would require a substantial porting effort. The open‑source license does not guarantee binary compatibility across GPU vendors.

    Mitigation: DeepSeek has pledged to open a “portable abstraction layer” for future releases, but until that materializes, organizations that prioritize multi‑vendor flexibility may hesitate to adopt DeepInfer as a long‑term solution.

    Outlook


    DeepSeek’s decision to open‑source its inference engine marks a strategic pivot from “black‑box API” to “open‑stack reference implementation.” The move supplies the community with a high‑performance baseline that matches DeepSeek’s production performance—a rarity among LLM vendors.

    If the engineering team sustains its release cadence, the upcoming DeepInfer‑X distributed runtime could extend the engine’s reach to multi‑node clusters, directly challenging the dominance of proprietary serving platforms like Microsoft’s Azure OpenAI Service. The partnership with Hugging Face already simplifies container deployment, and the hackathon fund should surface novel plugins (e.g., custom token‑filtering, on‑the‑fly LoRA adapters).

    Nevertheless, the engine’s long‑term success hinges on three factors:

    1. Contributor Velocity – Attract enough external maintainers to keep the kernel base up‑to‑date with evolving GPU architectures.
    2. Compliance Tooling – Provide out‑of‑the‑box checks for export‑control‑restricted models to lower legal risk for enterprise adopters.
    3. Hardware Agnosticism – Deliver a portable runtime that runs on AMD, Intel, and future accelerator stacks, broadening the addressable market beyond the current NVIDIA‑centric ecosystem.

    For now, the data speak clearly: DeepInfer delivers a measurable throughput lift, lower latency, and faster cold‑starts on the hardware it targets. Companies that can afford the latest GPUs and that need tight control over model hosting will find the engine attractive, especially in a regulatory climate that favors on‑premise deployment.

    The real test will appear six months from now, when the first community‑driven extensions land in production and the next wave of benchmarks pits DeepInfer‑X against the emerging wave of open‑source distributed runtimes. Until then, the engine stands as a technically solid, albeit narrowly scoped, addition to the LLM serving toolbox.

    Author’s note: All benchmark figures derive from DeepSeek’s internal release notes (Oct 2026) and have been cross‑checked against independent reproductions posted on GitHub (commit #f3b9c2) and the Hugging Face Model Hub. The analysis intentionally avoids marketing hyperbole and focuses on observable performance metrics.#deepseek #openai #nvidia #ai #software #coding #development #engineering #inclusive #community
    Why DeepSeek’s New Open-Source Inference Engine Could Outsmart OpenAI and NVIDIA

  30. #DeepInfer #opensources #DeepSeek’s #inferenceengine under Apache 2.0, enabling V4.1 Flash self-hosting with internal optimisations. Huawei Ascend 950 NPU and Nvidia SM100 are supported, though full production components remain absent. thenewstack.io/deepseek-deepin #AIagent #AI #ML #NLP #LLM #GenAI

  31. RT @tianyi: DeepSeek hat sein hochleistungsfähiges, großskaliges Inferenz-Framework DeepInfer unter der Apache-2.0-Lizenz open source gemacht.

    mehr auf Arint.info

    #AI #DeepInfer #DeepSeek #Inference #MachineLearning #OpenSource #arint_info

    https://x.com/tianyi/status/2112471106426900677

  32. Does something like AI even exist?

    The AI debate has become overheated and is taking on ridiculous tones. As is always the case with such debates, there are only black-and-white perspectives—and all within a specific framework that narrows the scope and prevents meaningful thinking on the subject. It seems silly.

    If you listen closely to Liang Wenfeng, the founder of #Deepseek, you’ll hear that Liang sees himself as a 100% part of the international #opensource #community and, with Deepseek, simply wants to continue what was already started with #free #software. It’s about the democratization of #knowledge. According to his philosophy, AIs are neither a new tool nor a product that can or should be sold, but rather naturally emerging synergies that arise from connecting the knowledge of the people who use the internet.

    So the problem isn’t this interconnection in and of itself, but—once again—the privatization of the commons by #thieves and #charlatans from #Silicon Valley or wherever. It makes a lot of sense to use this, and it makes a lot of sense to oppose the commodification of this knowledge. #Liang has given back to the community what #OpenAI wanted to steal! Thank you for that. #AI #OSS #FOSS #llm

  33. DeepSeek gives away the engine behind its cheap AI, 18 months after saying it wouldn’t
    DeepSeek has open-sourced DeepInfer, the engine behind its own AI service, for Nvidia Blackwell and Huawei Ascend 950 chips. What’s in it, what’s missing.

    #DeepSeek #OpenSource #AI

    madrobot.blog/2026/10/20/deeps

  34. Wegen Sicherheitsbedenken und möglicher Datenabflüsse nach China verbieten die #USA die Nutzung von #DeepSeek in zivilen Bundesbehörden nun vollständig. #KI winfuture.de/news,162076.html?

  35. Estats Units prohibeix l'ús de DeepSeek en entorns governamentals.

    Segueix el proteccionisme cap als xinesos però no hi ha aturador.

    elotrolado.net/noticias/tecnol

    #EstatsUnits #Xina #Deepseek #IA #AI

Share on Mastodon

Enter the server where you have an account.