#strixhalo — Public Fediverse posts

🧪 LLM Benchmark Showdown: 5 lokale Ollama-Modelle im Vergleich

Getestet auf derselben Hardware (#gmktecevo2 #AMDRyzenAIMaxPlus395 #strixhalo):
• #GSM8K (100 Samples) — Math
• #BFCL (100/Kategorie) — Function Calling
• #MBPP+ (50) — Python Coding
• #HumanEval+ (20) — Python Coding

📊 Ergebnisse (Accuracy / Output TK/s / VRAM):

**qwen3.8:27b**
GSM8K 82% | BFCL 91.5% | MBPP+ 100% | HE+ 100%
⚡ 25.5 TK/s | 💾 18 GB VRAM

**qwen3.6:27b**
GSM8K 83% | BFCL 93% | MBPP+ 98% | HE+ 75%
⚡ 12.7 TK/s | 💾 33 GB VRAM

**qwen3.6:35b**
GSM8K 84% | BFCL 90% | MBPP+ 98% | HE+ 55%
⚡ 61.8 TK/s | 💾 27 GB VRAM

**ornith-1.5:35b**
GSM8K 75% | BFCL 92.5% | MBPP+ 78% | HE+ 0%
⚡ 63.6 TK/s | 💾 26 GB VRAM

**nemotron-3.5-lightning:30b**
GSM8K 59% | BFCL 74% | MBPP+ 94% | HE+ 0%
⚡ 91.9 TK/s | 💾 26 GB VRAM

🏆 Fazit:

qwen3.8:27b ist der klare Sieger — als einziges Modell 100% bei beiden Coding-Benchmarks, bei GSM8K/BFCL gleichauf mit den anderen Qwen-Modellen. Bei 25.5 TK/s und nur 18 GB VRAM das beste Qualität/Speed/Effizienz-Verhältnis.

qwen3.6:27b ist qualitativ nah dran (BFCL sogar 93%), aber mit 12.7 TK/s unerträglich langsam und frisst 33 GB VRAM — fast 2× so viel wie qwen3.8 bei halber Speed.

qwen3.6:35b ist mit 61.8 TK/s 2.4× schneller als qwen3.8, aber HE+ nur 55% (vs 100%). Trading Code-Qualität für Speed.

ornith-1.5:35b und nemotron-3.5-lightning:30b fallen bei Coding komplett durch (HE+ 0%), sind aber die schnellsten Modelle im Feld (64 / 92 TK/s).

💡 TK/s = generierte Tokens/Sekunde (Warm-Run, ollama --verbose).
💾 VRAM = GPU-Speicher bei max context (262K bzw. 1M bei nemotron).

#LLM #Benchmark #Ollama #LocalAI #Qwen #OpenSource

More AI news from AMD, re-use of the better parts of their Strix Halo yield for industrial use cases.

https://www.servethehome.com/amds-physical-ai-plans-come-into-focus-as-company-launches-ryzen-embedded-ai-x100/

"Physical AI" aka robotics and edge use cases. Buzzword galore! 😆
Still remember when "edge" was the new buzzword Pepperidge Farm Remembers

Something I do find interesting is the claim of hard real-time assurances whilst virtualized with Xen.

Technically a guaranteed deadline of 2 years is hard real-time too, just as MS-DOS is an amazing real-time OS, but I'm sure that's not what they're talking about...

Any one got more info on the Xen claim? Haven't heard so much about them these days...

#amd #strixhalo #ai #EmbedddedSystems #PhysicalAI #edgecomputing #robotics #xen #virtualization #realtime #rtos #msdos

ONEXPLAYER X2 Mini Pro handheld gaming PC with Ryzen AI Max+ 388 hits Indiegogo for $2466 and up

The ONEXPLAYER X2 Mini Pro is a handheld game console with an 8.8 inch, 1920 x 1200 pixel, 30 -144 Hz AMOLED display, detachable controllers, and the most powerful graphics currently available for a device this size.

But with an AMD Strix Halo processor and at least 48GB of high-speed memory inside, it’s unsurprising that this handheld is expensive. The ONEXPLAYER X2 Mini Pro is now available […]

ONEXPLAYER X2 Mini is a Ryzen AI Max+ 395 handheld gaming PC with detachable controllers

The ONEXPLAYER X2 Mini is an upcoming handheld gaming PC with a feature list that’s too good to be… cheap.

It has an 8.8 inch OLED display with support for variable refresh rates, detachable Bluetooth controllers that let you use the system like a game console or a tablet, and a magnetic keyboard that turns the system into a sort of tiny laptop. And with an AMD Ryzen AI Max+ 395 processor, […]

Lilbits: Atari and Intellivision made a retro console (kind of), Google’s Privacy Sandbox is gone for good, and Amazon’s Fire TV Stick 4K Select with Vega OS is a lot more locked down

Atari and Intellivision have a few things in common. They were two of the first big players in the home video game console space. And neither brand is what it once was anymore.

So while it’s intriguing to see that Atari is launching a new retro console called the Intellivision Sprint, this is really a partnership between the company that now owns the rights to the Atari name and retro game […]

#amazonFireTvStick4kSelect #atari #bluetoothSpeaker #edifier #fairphone #fairphone4 #fireTvStick4kSelect #google #intellivision #intellivisionSprint #lilbits #linuxLaptop #morefineH1 #ploopy #privacySandbox #retroConsole #retroGaming #samsungGalaxyS26Edge #strixHalo #tuxedoInfinitybookPro15 #vegaOs

Read more: https://liliputing.com/lilbits-atari-and-intellivision-made-a-retro-console-kind-of-googles-privacy-sandbox-is-gone-for-good-and-amazons-fire-tv-stick-4k-select-with-vega-os-is-a-lot-more-locked-down/