12 results for “michabbb”
🔧 Runs on #vLLM with Aleph Alpha's inference plugin, exposing an OpenAI-compatible API. Needs 2x A100/H100 80 GB or 1x H200/B200/B300. Best fit: on-prem #RAG over long German documents like laws, contracts and manuals
🆓 No GPU at hand? Tesseracted Labs hosts Kolibri-1 free for anyone to try over the next few days, no setup needed: https://tesseracted.com/kolibri-1-chat/
📏 262,144 tokens of native context, validated up to 1,048,576. 40 of 50 layers use 512-token sliding-window attention, every 5th layer attends to everything. RULER at 1M tokens: 63.2 vs 57.5 for #Qwen3.5 35B-A3B
🇩🇪 Reasons in German on German prompts, with 4 reasoning effort levels (none, low, medium, high). AIME 2025: 87.5 in German, 96.9 in English. Trained with the Merlin-Arthur protocol to abstain: it says "I don't know" 44% of the time instead of hallucinating, vs 11.1% for Qwen3.5 35B-A3B
🐦 #AlephAlpha released #Kolibri, an open-weight #LLM for German and English under the Apache 2.0 license. A #MixtureOfExperts with 78.1B parameters, of which only 3.46B are active per token. Trained from scratch on ~24T tokens (over a fifth German) using 768 #NVIDIA B200 GPUs in Germany and Finland. Weights on #HuggingFace #SovereignAI #opensource #AI
🧵👇🇩🇪