#openvino — Public Fediverse posts

My kid has released another tool that he's written for himself:

Ovi is a lightweight local model server that delivers an ollama‑style developer experience, built natively on Intel’s OpenVINO runtime for efficient CPU and GPU inference:

https://github.com/nathanael-thms/ovi.

Check out the docs at https://ovi.nattho.com

#ProudDad #python #openvino #ai #ovi #ollama

My kid has released another tool that he's written for himself:

Ovi is a lightweight local model server that delivers an ollama‑style developer experience, built natively on Intel’s OpenVINO runtime for efficient CPU and GPU inference:

https://github.com/nathanael-thms/ovi.

Check out the docs at https://ovi.nattho.com

#ProudDad #python #openvino #ai #ovi #ollama

My kid has released another tool that he's written for himself:

Ovi is a lightweight local model server that delivers an ollama‑style developer experience, built natively on Intel’s OpenVINO runtime for efficient CPU and GPU inference:

https://github.com/nathanael-thms/ovi.

Check out the docs at https://ovi.nattho.com

#ProudDad #python #openvino #ai #ovi #ollama

My kid has released another tool that he's written for himself:

Ovi is a lightweight local model server that delivers an ollama‑style developer experience, built natively on Intel’s OpenVINO runtime for efficient CPU and GPU inference:

https://github.com/nathanael-thms/ovi.

Check out the docs at https://ovi.nattho.com

#ProudDad #python #openvino #ai #ovi #ollama

My kid has released another tool that he's written for himself:

Ovi is a lightweight local model server that delivers an ollama‑style developer experience, built natively on Intel’s OpenVINO runtime for efficient CPU and GPU inference:

https://github.com/nathanael-thms/ovi.

Check out the docs at https://ovi.nattho.com

#ProudDad #python #openvino #ai #ovi #ollama

📬 GEEKOM M16 und X14 Pro im Vergleich
#Test #CoreUltra9185H #CrucialNVMe #GEEKOMM16 #GEEKOMX14Pro #IPSDisplay #OpenVINO https://sc.tarnkappe.info/41a2de

📬 GEEKOM M16 und X14 Pro im Vergleich
#Test #CoreUltra9185H #CrucialNVMe #GEEKOMM16 #GEEKOMX14Pro #IPSDisplay #OpenVINO https://sc.tarnkappe.info/41a2de

📬 GEEKOM M16 und X14 Pro im Vergleich
#Test #CoreUltra9185H #CrucialNVMe #GEEKOMM16 #GEEKOMX14Pro #IPSDisplay #OpenVINO https://sc.tarnkappe.info/41a2de

📬 GEEKOM M16 und X14 Pro im Vergleich
#Test #CoreUltra9185H #CrucialNVMe #GEEKOMM16 #GEEKOMX14Pro #IPSDisplay #OpenVINO https://sc.tarnkappe.info/41a2de

📬 GEEKOM M16 und X14 Pro im Vergleich
#Test #CoreUltra9185H #CrucialNVMe #GEEKOMM16 #GEEKOMX14Pro #IPSDisplay #OpenVINO https://sc.tarnkappe.info/41a2de

I made this #YouTube video for work using #OpenSource. #Audacity with #OpenVINO to clean up the #Audio #Inkscape for the lower thirds and #Kdenlive to edit everything. Oh, and #Whisper to automatically create the #subtitles, which is did an amazing job, better than Audacity and OpenVINO did. Only would have been better if I did it on my home #kubuntu desktop but open source #software is the best and all ran on my Windows workstation.

https://youtu.be/YEkgv__LgGw?si=C73y62hSDyeT0X5L

I made this #YouTube video for work using #OpenSource. #Audacity with #OpenVINO to clean up the #Audio #Inkscape for the lower thirds and #Kdenlive to edit everything. Oh, and #Whisper to automatically create the #subtitles, which is did an amazing job, better than Audacity and OpenVINO did. Only would have been better if I did it on my home #kubuntu desktop but open source #software is the best and all ran on my Windows workstation.

https://youtu.be/YEkgv__LgGw?si=C73y62hSDyeT0X5L

I made this #YouTube video for work using #OpenSource. #Audacity with #OpenVINO to clean up the #Audio #Inkscape for the lower thirds and #Kdenlive to edit everything. Oh, and #Whisper to automatically create the #subtitles, which is did an amazing job, better than Audacity and OpenVINO did. Only would have been better if I did it on my home #kubuntu desktop but open source #software is the best and all ran on my Windows workstation.

https://youtu.be/YEkgv__LgGw?si=C73y62hSDyeT0X5L

Intel Arc Pro B70、NVIDIA RTX 4000比でAI推論処理量が最大2.24倍に — BigGo ファイナンス https://www.yayafa.com/2825367/ #AgenticAi #AI #ArtificialGeneralIntelligence #ArtificialIntelligence #BackendAI #GPTOSS20B #Intel #IntelArcProB70 #KVキャッシュ #LLM #NVIDIA #NVIDIARTXPRO4000Blackwell #OpenVINO #Qwen38B #RableUp #vLLM #エージェンティックAI #エージェント型AI #人工知能 #汎用人工知能

Intel Arc Pro B70、NVIDIA RTX 4000比でAI推論処理量が最大2.24倍に — BigGo ファイナンス https://www.yayafa.com/2825367/ #AgenticAi #AI #ArtificialGeneralIntelligence #ArtificialIntelligence #BackendAI #GPTOSS20B #Intel #IntelArcProB70 #KVキャッシュ #LLM #NVIDIA #NVIDIARTXPRO4000Blackwell #OpenVINO #Qwen38B #RableUp #vLLM #エージェンティックAI #エージェント型AI #人工知能 #汎用人工知能

Intel AMXの効果を oneDNNと OpenVINO GenAIで確認してみてみた
https://qiita.com/shirok/items/e6f8f5f7867d335814dd?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items

#qiita #AI #oraclecloud #OpenVINO #AMX #OneDNN

Intel AMXの効果を oneDNNと OpenVINO GenAIで確認してみてみた
https://qiita.com/shirok/items/e6f8f5f7867d335814dd?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items

#qiita #AI #oraclecloud #OpenVINO #AMX #OneDNN

(more Linux and FOSS news in previous posts of thread)

Zed Editor launches Agent Metrics, offering public AI agent usage data:
https://alternativeto.net/news/2026/4/zed-editor-launches-agent-metrics-offering-public-ai-agent-usage-data/

Immich 2.7 adds duplicate resolution, editor shortcuts, new web actions, and much more:
https://alternativeto.net/news/2026/4/immich-2-7-adds-duplicate-resolution-editor-shortcuts-new-web-actions-and-much-more/

SQLite 3.53 fixes WAL-reset bug, adds QRF library, new SQL features, improved CLI and more:
https://alternativeto.net/news/2026/4/sqlite-3-53-fixes-wal-reset-bug-adds-qrf-library-new-sql-features-improved-cli-and-more/

GNU nano 9.0 CLI Text Editor Released with New Features and Improvements:
https://9to5linux.com/gnu-nano-9-0-cli-text-editor-released-with-new-features-and-improvements

Microsoft has terminated developer accounts of VeraCrypt, WireGuard & Windscribe software:
https://alternativeto.net/news/2026/4/microsoft-has-terminated-developer-accounts-of-veracrypt-wireguard-and-windscribe-software/
(It was only by accident, right, Microsoft? RIGHT??)

FosseryWeb progress report:
I regenerated the HTML cheatsheets using the new page-builders tool, and fixed a lot of bugs/mistakes. Now I'm working on regenerating the JavaScript cheatsheets.
https://fosseryweb.codeberg.page/@beta/cheatsheets/
https://fosseryweb-min.codeberg.page/@beta/cheatsheets/

Vulkan 1.4.349 Released With Data Graph Optical Flow Extension:
https://www.phoronix.com/news/Vulkan-1.4.349

Hugging Face Contributes Safetensors To PyTorch Foundation To Secure AI Model Execution:
https://www.phoronix.com/news/PyTorch-Safetensors

Godot gets a funding boost from Slay the Spire 2 devs Mega Crit:
https://www.gamingonlinux.com/2026/04/godot-gets-a-funding-boost-from-slay-the-spire-2-devs-mega-crit/

Legendary, the free and open source Epic Games Launcher, has moved to a new organisation:
https://www.gamingonlinux.com/2026/04/legendary-the-free-and-open-source-epic-games-launcher-has-moved-to-a-new-organisation/

Raspberry Pi Imager 2.0.8 Released with Fastboot Improvements, Bug Fixes:
https://9to5linux.com/raspberry-pi-imager-2-0-8-released-with-fastboot-improvements-bug-fixes

Redox OS Establishes AI Policy To Forbid Contributions Made Using LLMs:
https://www.phoronix.com/news/Redox-OS-March-2026

NetBSD 11.0 Nears Release With RC3 Released For Testing:
https://www.phoronix.com/news/NetBSD-11.0-RC3

Intel Releases OpenVINO 2026.1 With Backend For Llama.cpp, New Hardware Support:
https://www.phoronix.com/news/OpenVINO-2026.1-Released

#WeeklyNews #OpenSource #FOSSNews #OpenSourceNews #FOSS #News #Zed #Immich #SQLite #GNUNano #FosseryWeb #FosseryWebMin #Vulkan #AI #ArtificialIntelligence #HuggingFace #GodotEngine #Godot #RaspberryPIImager #RedoxOS #NetBSD #OpenVINO #Llamacpp #PyTorch #DBMS #SelfHosting #Development #IDE #CodeEditor #TextEditor #Programming #Dev #BSD #FosseryTech

(more Linux and FOSS news in previous posts of thread)

Zed Editor launches Agent Metrics, offering public AI agent usage data:
https://alternativeto.net/news/2026/4/zed-editor-launches-agent-metrics-offering-public-ai-agent-usage-data/

Immich 2.7 adds duplicate resolution, editor shortcuts, new web actions, and much more:
https://alternativeto.net/news/2026/4/immich-2-7-adds-duplicate-resolution-editor-shortcuts-new-web-actions-and-much-more/

SQLite 3.53 fixes WAL-reset bug, adds QRF library, new SQL features, improved CLI and more:
https://alternativeto.net/news/2026/4/sqlite-3-53-fixes-wal-reset-bug-adds-qrf-library-new-sql-features-improved-cli-and-more/

GNU nano 9.0 CLI Text Editor Released with New Features and Improvements:
https://9to5linux.com/gnu-nano-9-0-cli-text-editor-released-with-new-features-and-improvements

Microsoft has terminated developer accounts of VeraCrypt, WireGuard & Windscribe software:
https://alternativeto.net/news/2026/4/microsoft-has-terminated-developer-accounts-of-veracrypt-wireguard-and-windscribe-software/
(It was only by accident, right, Microsoft? RIGHT??)

FosseryWeb progress report:
I regenerated the HTML cheatsheets using the new page-builders tool, and fixed a lot of bugs/mistakes. Now I'm working on regenerating the JavaScript cheatsheets.
https://fosseryweb.codeberg.page/@beta/cheatsheets/
https://fosseryweb-min.codeberg.page/@beta/cheatsheets/

Vulkan 1.4.349 Released With Data Graph Optical Flow Extension:
https://www.phoronix.com/news/Vulkan-1.4.349

Hugging Face Contributes Safetensors To PyTorch Foundation To Secure AI Model Execution:
https://www.phoronix.com/news/PyTorch-Safetensors

Godot gets a funding boost from Slay the Spire 2 devs Mega Crit:
https://www.gamingonlinux.com/2026/04/godot-gets-a-funding-boost-from-slay-the-spire-2-devs-mega-crit/

Legendary, the free and open source Epic Games Launcher, has moved to a new organisation:
https://www.gamingonlinux.com/2026/04/legendary-the-free-and-open-source-epic-games-launcher-has-moved-to-a-new-organisation/

Raspberry Pi Imager 2.0.8 Released with Fastboot Improvements, Bug Fixes:
https://9to5linux.com/raspberry-pi-imager-2-0-8-released-with-fastboot-improvements-bug-fixes

Redox OS Establishes AI Policy To Forbid Contributions Made Using LLMs:
https://www.phoronix.com/news/Redox-OS-March-2026

NetBSD 11.0 Nears Release With RC3 Released For Testing:
https://www.phoronix.com/news/NetBSD-11.0-RC3

Intel Releases OpenVINO 2026.1 With Backend For Llama.cpp, New Hardware Support:
https://www.phoronix.com/news/OpenVINO-2026.1-Released

#WeeklyNews #OpenSource #FOSSNews #OpenSourceNews #FOSS #News #Zed #Immich #SQLite #GNUNano #FosseryWeb #FosseryWebMin #Vulkan #AI #ArtificialIntelligence #HuggingFace #GodotEngine #Godot #RaspberryPIImager #RedoxOS #NetBSD #OpenVINO #Llamacpp #PyTorch #DBMS #SelfHosting #Development #IDE #CodeEditor #TextEditor #Programming #Dev #BSD #FosseryTech

(more Linux and FOSS news in previous posts of thread)

Zed Editor launches Agent Metrics, offering public AI agent usage data:
https://alternativeto.net/news/2026/4/zed-editor-launches-agent-metrics-offering-public-ai-agent-usage-data/

Immich 2.7 adds duplicate resolution, editor shortcuts, new web actions, and much more:
https://alternativeto.net/news/2026/4/immich-2-7-adds-duplicate-resolution-editor-shortcuts-new-web-actions-and-much-more/

SQLite 3.53 fixes WAL-reset bug, adds QRF library, new SQL features, improved CLI and more:
https://alternativeto.net/news/2026/4/sqlite-3-53-fixes-wal-reset-bug-adds-qrf-library-new-sql-features-improved-cli-and-more/

GNU nano 9.0 CLI Text Editor Released with New Features and Improvements:
https://9to5linux.com/gnu-nano-9-0-cli-text-editor-released-with-new-features-and-improvements

Microsoft has terminated developer accounts of VeraCrypt, WireGuard & Windscribe software:
https://alternativeto.net/news/2026/4/microsoft-has-terminated-developer-accounts-of-veracrypt-wireguard-and-windscribe-software/
(It was only by accident, right, Microsoft? RIGHT??)

FosseryWeb progress report:
I regenerated the HTML cheatsheets using the new page-builders tool, and fixed a lot of bugs/mistakes. Now I'm working on regenerating the JavaScript cheatsheets.
https://fosseryweb.codeberg.page/@beta/cheatsheets/
https://fosseryweb-min.codeberg.page/@beta/cheatsheets/

Vulkan 1.4.349 Released With Data Graph Optical Flow Extension:
https://www.phoronix.com/news/Vulkan-1.4.349

Hugging Face Contributes Safetensors To PyTorch Foundation To Secure AI Model Execution:
https://www.phoronix.com/news/PyTorch-Safetensors

Godot gets a funding boost from Slay the Spire 2 devs Mega Crit:
https://www.gamingonlinux.com/2026/04/godot-gets-a-funding-boost-from-slay-the-spire-2-devs-mega-crit/

Legendary, the free and open source Epic Games Launcher, has moved to a new organisation:
https://www.gamingonlinux.com/2026/04/legendary-the-free-and-open-source-epic-games-launcher-has-moved-to-a-new-organisation/

Raspberry Pi Imager 2.0.8 Released with Fastboot Improvements, Bug Fixes:
https://9to5linux.com/raspberry-pi-imager-2-0-8-released-with-fastboot-improvements-bug-fixes

Redox OS Establishes AI Policy To Forbid Contributions Made Using LLMs:
https://www.phoronix.com/news/Redox-OS-March-2026

NetBSD 11.0 Nears Release With RC3 Released For Testing:
https://www.phoronix.com/news/NetBSD-11.0-RC3

Intel Releases OpenVINO 2026.1 With Backend For Llama.cpp, New Hardware Support:
https://www.phoronix.com/news/OpenVINO-2026.1-Released

#WeeklyNews #OpenSource #FOSSNews #OpenSourceNews #FOSS #News #Zed #Immich #SQLite #GNUNano #FosseryWeb #FosseryWebMin #Vulkan #AI #ArtificialIntelligence #HuggingFace #GodotEngine #Godot #RaspberryPIImager #RedoxOS #NetBSD #OpenVINO #Llamacpp #PyTorch #DBMS #SelfHosting #Development #IDE #CodeEditor #TextEditor #Programming #Dev #BSD #FosseryTech

(more Linux and FOSS news in previous posts of thread)

Zed Editor launches Agent Metrics, offering public AI agent usage data:
https://alternativeto.net/news/2026/4/zed-editor-launches-agent-metrics-offering-public-ai-agent-usage-data/

Immich 2.7 adds duplicate resolution, editor shortcuts, new web actions, and much more:
https://alternativeto.net/news/2026/4/immich-2-7-adds-duplicate-resolution-editor-shortcuts-new-web-actions-and-much-more/

SQLite 3.53 fixes WAL-reset bug, adds QRF library, new SQL features, improved CLI and more:
https://alternativeto.net/news/2026/4/sqlite-3-53-fixes-wal-reset-bug-adds-qrf-library-new-sql-features-improved-cli-and-more/

GNU nano 9.0 CLI Text Editor Released with New Features and Improvements:
https://9to5linux.com/gnu-nano-9-0-cli-text-editor-released-with-new-features-and-improvements

Microsoft has terminated developer accounts of VeraCrypt, WireGuard & Windscribe software:
https://alternativeto.net/news/2026/4/microsoft-has-terminated-developer-accounts-of-veracrypt-wireguard-and-windscribe-software/
(It was only by accident, right, Microsoft? RIGHT??)

FosseryWeb progress report:
I regenerated the HTML cheatsheets using the new page-builders tool, and fixed a lot of bugs/mistakes. Now I'm working on regenerating the JavaScript cheatsheets.
https://fosseryweb.codeberg.page/@beta/cheatsheets/
https://fosseryweb-min.codeberg.page/@beta/cheatsheets/

Vulkan 1.4.349 Released With Data Graph Optical Flow Extension:
https://www.phoronix.com/news/Vulkan-1.4.349

Hugging Face Contributes Safetensors To PyTorch Foundation To Secure AI Model Execution:
https://www.phoronix.com/news/PyTorch-Safetensors

Godot gets a funding boost from Slay the Spire 2 devs Mega Crit:
https://www.gamingonlinux.com/2026/04/godot-gets-a-funding-boost-from-slay-the-spire-2-devs-mega-crit/

Legendary, the free and open source Epic Games Launcher, has moved to a new organisation:
https://www.gamingonlinux.com/2026/04/legendary-the-free-and-open-source-epic-games-launcher-has-moved-to-a-new-organisation/

Raspberry Pi Imager 2.0.8 Released with Fastboot Improvements, Bug Fixes:
https://9to5linux.com/raspberry-pi-imager-2-0-8-released-with-fastboot-improvements-bug-fixes

Redox OS Establishes AI Policy To Forbid Contributions Made Using LLMs:
https://www.phoronix.com/news/Redox-OS-March-2026

NetBSD 11.0 Nears Release With RC3 Released For Testing:
https://www.phoronix.com/news/NetBSD-11.0-RC3

Intel Releases OpenVINO 2026.1 With Backend For Llama.cpp, New Hardware Support:
https://www.phoronix.com/news/OpenVINO-2026.1-Released

#WeeklyNews #OpenSource #FOSSNews #OpenSourceNews #FOSS #News #Zed #Immich #SQLite #GNUNano #FosseryWeb #FosseryWebMin #Vulkan #AI #ArtificialIntelligence #HuggingFace #GodotEngine #Godot #RaspberryPIImager #RedoxOS #NetBSD #OpenVINO #Llamacpp #PyTorch #DBMS #SelfHosting #Development #IDE #CodeEditor #TextEditor #Programming #Dev #BSD #FosseryTech

(more Linux and FOSS news in previous posts of thread)

Zed Editor launches Agent Metrics, offering public AI agent usage data:
https://alternativeto.net/news/2026/4/zed-editor-launches-agent-metrics-offering-public-ai-agent-usage-data/

Immich 2.7 adds duplicate resolution, editor shortcuts, new web actions, and much more:
https://alternativeto.net/news/2026/4/immich-2-7-adds-duplicate-resolution-editor-shortcuts-new-web-actions-and-much-more/

SQLite 3.53 fixes WAL-reset bug, adds QRF library, new SQL features, improved CLI and more:
https://alternativeto.net/news/2026/4/sqlite-3-53-fixes-wal-reset-bug-adds-qrf-library-new-sql-features-improved-cli-and-more/

GNU nano 9.0 CLI Text Editor Released with New Features and Improvements:
https://9to5linux.com/gnu-nano-9-0-cli-text-editor-released-with-new-features-and-improvements

Microsoft has terminated developer accounts of VeraCrypt, WireGuard & Windscribe software:
https://alternativeto.net/news/2026/4/microsoft-has-terminated-developer-accounts-of-veracrypt-wireguard-and-windscribe-software/
(It was only by accident, right, Microsoft? RIGHT??)

FosseryWeb progress report:
I regenerated the HTML cheatsheets using the new page-builders tool, and fixed a lot of bugs/mistakes. Now I'm working on regenerating the JavaScript cheatsheets.
https://fosseryweb.codeberg.page/@beta/cheatsheets/
https://fosseryweb-min.codeberg.page/@beta/cheatsheets/

Vulkan 1.4.349 Released With Data Graph Optical Flow Extension:
https://www.phoronix.com/news/Vulkan-1.4.349

Hugging Face Contributes Safetensors To PyTorch Foundation To Secure AI Model Execution:
https://www.phoronix.com/news/PyTorch-Safetensors

Godot gets a funding boost from Slay the Spire 2 devs Mega Crit:
https://www.gamingonlinux.com/2026/04/godot-gets-a-funding-boost-from-slay-the-spire-2-devs-mega-crit/

Legendary, the free and open source Epic Games Launcher, has moved to a new organisation:
https://www.gamingonlinux.com/2026/04/legendary-the-free-and-open-source-epic-games-launcher-has-moved-to-a-new-organisation/

Raspberry Pi Imager 2.0.8 Released with Fastboot Improvements, Bug Fixes:
https://9to5linux.com/raspberry-pi-imager-2-0-8-released-with-fastboot-improvements-bug-fixes

Redox OS Establishes AI Policy To Forbid Contributions Made Using LLMs:
https://www.phoronix.com/news/Redox-OS-March-2026

NetBSD 11.0 Nears Release With RC3 Released For Testing:
https://www.phoronix.com/news/NetBSD-11.0-RC3

Intel Releases OpenVINO 2026.1 With Backend For Llama.cpp, New Hardware Support:
https://www.phoronix.com/news/OpenVINO-2026.1-Released

#WeeklyNews #OpenSource #FOSSNews #OpenSourceNews #FOSS #News #Zed #Immich #SQLite #GNUNano #FosseryWeb #FosseryWebMin #Vulkan #AI #ArtificialIntelligence #HuggingFace #GodotEngine #Godot #RaspberryPIImager #RedoxOS #NetBSD #OpenVINO #Llamacpp #PyTorch #DBMS #SelfHosting #Development #IDE #CodeEditor #TextEditor #Programming #Dev #BSD #FosseryTech

OpenVINO 2026.0.0 release!

https://www.intel.com/content/www/us/en/developer/tools/openvino-toolkit/download.html?PACKAGE=OPENVINO_BASE&VERSION=v_2026_0_0&OP_SYSTEM=LINUX&DISTRIBUTION=PIP

This release includes features that improve GenAI model performance and accuracy while reducing friction to accelerate time-to-value.

Key Highlights:
---------------------
More Gen AI coverage and framework integrations to minimize code changes:
- New models supported on CPUs & GPUs: GPT-OSS-20B, Qwen3-30B-A3B, MiniCPM-V-4_5-8B, and MiniCPM-o-2.6.
- New models supported on NPUs: MiniCPM-o-2.6. In addition, NPU support is now available on Qwen2.5-1B-Instruct, Qwen3-Embedding-0.6B, Qwen-2.5-coder-0.5B.
- Preview: OpenVINO™ GenAI adds support for video generation pipeline based on LTX-Video model on CPU and GPUs.
- OpenVINO™ GenAI now adds word-level timestamp functionality to the Whisper Pipeline on CPUs, GPUs, and NPUs, enabling more accurate transcriptions and subtitling in line with OpenAI and FasterWhisper implementations.

Broader LLM model support and more model compression techniques:
- OpenVINO™ GenAI and OpenVINO™ Model Server introduces EAGLE-3 speculative decoding to accelerate LLM inference using smarter token prediction on Intel CPUs and GPUs. Validated on Qwen3-8B model.
- With the new int4 data-aware weight compression for 3D MatMuls, the Neural Network Compression Framework enables MoE LLMs to run with reduced memory, bandwidth, and improved accuracy compared to data-free schemes-delivering faster, more efficient deployment on resource-constrained devices.
- Preview: The Neural Network Compression Framework now supports per-layer and per-group Look-Up Tables (LUT) for FP8-4BLUT quantization. This enables fine-grained, codebook-based compression that reduces model size and bandwidth while improving inference speed and accuracy for LLMs and transformer workloads.

More portability and performance to run AI at the edge, in the cloud or locally:
- OpenVINO™ GenAI adds VLM pipeline support to enhance Agentic AI framework integration.
- OpenVINO GenAI now supports speculative decoding for NPUs, delivering improved performance and efficient text generation through a small draft model that is periodically validated by the full-size model.
- Preview: NPU compiler integration with the NPU plugin enables ahead-of-time and on-device compilation without relying on OEM driver updates. Developers can enable this feature for a single, ready-to-ship package that reduces integration friction and accelerates time-to-value.
- OpenVINO™ Model Server adds enhanced support for audio endpoint plus agentic continuous batching and concurrent runs for improved LLM performance in agentic workflows on Intel CPUs and GPUs.

#intel #openvino

OpenVINO 2026.0.0 release!

https://www.intel.com/content/www/us/en/developer/tools/openvino-toolkit/download.html?PACKAGE=OPENVINO_BASE&VERSION=v_2026_0_0&OP_SYSTEM=LINUX&DISTRIBUTION=PIP

This release includes features that improve GenAI model performance and accuracy while reducing friction to accelerate time-to-value.

Key Highlights:
---------------------
More Gen AI coverage and framework integrations to minimize code changes:
- New models supported on CPUs & GPUs: GPT-OSS-20B, Qwen3-30B-A3B, MiniCPM-V-4_5-8B, and MiniCPM-o-2.6.
- New models supported on NPUs: MiniCPM-o-2.6. In addition, NPU support is now available on Qwen2.5-1B-Instruct, Qwen3-Embedding-0.6B, Qwen-2.5-coder-0.5B.
- Preview: OpenVINO™ GenAI adds support for video generation pipeline based on LTX-Video model on CPU and GPUs.
- OpenVINO™ GenAI now adds word-level timestamp functionality to the Whisper Pipeline on CPUs, GPUs, and NPUs, enabling more accurate transcriptions and subtitling in line with OpenAI and FasterWhisper implementations.

Broader LLM model support and more model compression techniques:
- OpenVINO™ GenAI and OpenVINO™ Model Server introduces EAGLE-3 speculative decoding to accelerate LLM inference using smarter token prediction on Intel CPUs and GPUs. Validated on Qwen3-8B model.
- With the new int4 data-aware weight compression for 3D MatMuls, the Neural Network Compression Framework enables MoE LLMs to run with reduced memory, bandwidth, and improved accuracy compared to data-free schemes-delivering faster, more efficient deployment on resource-constrained devices.
- Preview: The Neural Network Compression Framework now supports per-layer and per-group Look-Up Tables (LUT) for FP8-4BLUT quantization. This enables fine-grained, codebook-based compression that reduces model size and bandwidth while improving inference speed and accuracy for LLMs and transformer workloads.

More portability and performance to run AI at the edge, in the cloud or locally:
- OpenVINO™ GenAI adds VLM pipeline support to enhance Agentic AI framework integration.
- OpenVINO GenAI now supports speculative decoding for NPUs, delivering improved performance and efficient text generation through a small draft model that is periodically validated by the full-size model.
- Preview: NPU compiler integration with the NPU plugin enables ahead-of-time and on-device compilation without relying on OEM driver updates. Developers can enable this feature for a single, ready-to-ship package that reduces integration friction and accelerates time-to-value.
- OpenVINO™ Model Server adds enhanced support for audio endpoint plus agentic continuous batching and concurrent runs for improved LLM performance in agentic workflows on Intel CPUs and GPUs.

#intel #openvino

Well, it worked. As expected. But does someone know what is needed for #immich machine learning container to get #openvino attached to mini gpu of NUC? Some tag in deployment allowing the attach?

Well, it worked. As expected. But does someone know what is needed for #immich machine learning container to get #openvino attached to mini gpu of NUC? Some tag in deployment allowing the attach?

Well, it worked. As expected. But does someone know what is needed for #immich machine learning container to get #openvino attached to mini gpu of NUC? Some tag in deployment allowing the attach?

Well, it worked. As expected. But does someone know what is needed for #immich machine learning container to get #openvino attached to mini gpu of NUC? Some tag in deployment allowing the attach?

Well, it worked. As expected. But does someone know what is needed for #immich machine learning container to get #openvino attached to mini gpu of NUC? Some tag in deployment allowing the attach?

Fazit nach paar Stunden #frigate mit #openvino

Hunde und Katzen zu unterscheiden fällt der LLM ganz schön schwer. Besonders wenn Kater #cooper durchs Bild marschiert. Der ist halt echt schwarz und das kann openvino schwer kompensieren. Man sieht, dass es da auch unsicherheiten gibt. Manchmal nur knapp über 50%. Personen hingegen werden zu knapp 100% erkannt.

Fazit nach paar Stunden #frigate mit #openvino

Hunde und Katzen zu unterscheiden fällt der LLM ganz schön schwer. Besonders wenn Kater #cooper durchs Bild marschiert. Der ist halt echt schwarz und das kann openvino schwer kompensieren. Man sieht, dass es da auch unsicherheiten gibt. Manchmal nur knapp über 50%. Personen hingegen werden zu knapp 100% erkannt.

Fazit nach paar Stunden #frigate mit #openvino

Hunde und Katzen zu unterscheiden fällt der LLM ganz schön schwer. Besonders wenn Kater #cooper durchs Bild marschiert. Der ist halt echt schwarz und das kann openvino schwer kompensieren. Man sieht, dass es da auch unsicherheiten gibt. Manchmal nur knapp über 50%. Personen hingegen werden zu knapp 100% erkannt.

Fazit nach paar Stunden #frigate mit #openvino

Hunde und Katzen zu unterscheiden fällt der LLM ganz schön schwer. Besonders wenn Kater #cooper durchs Bild marschiert. Der ist halt echt schwarz und das kann openvino schwer kompensieren. Man sieht, dass es da auch unsicherheiten gibt. Manchmal nur knapp über 50%. Personen hingegen werden zu knapp 100% erkannt.

📬 Das GEEKOM GeekBook X14 Pro im Alltagstest
#Test #CopilotTaste #GeekBookX14Pro #GEEKOM #Notebook #OpenVINO https://sc.tarnkappe.info/dbb445

📬 Das GEEKOM GeekBook X14 Pro im Alltagstest
#Test #CopilotTaste #GeekBookX14Pro #GEEKOM #Notebook #OpenVINO https://sc.tarnkappe.info/dbb445

📬 Das GEEKOM GeekBook X14 Pro im Alltagstest
#Test #CopilotTaste #GeekBookX14Pro #GEEKOM #Notebook #OpenVINO https://sc.tarnkappe.info/dbb445

📬 Das GEEKOM GeekBook X14 Pro im Alltagstest
#Test #CopilotTaste #GeekBookX14Pro #GEEKOM #Notebook #OpenVINO https://sc.tarnkappe.info/dbb445

📬 Das GEEKOM GeekBook X14 Pro im Alltagstest
#Test #CopilotTaste #GeekBookX14Pro #GEEKOM #Notebook #OpenVINO https://sc.tarnkappe.info/dbb445

Intel Core Ultra Series 3 Panther Lake-H CPU powers TGS-2000 series stackable Edge AI computers

https://fed.brid.gy/r/https://www.cnx-software.com/2026/01/08/intel-core-ultra-series-3-panther-lake-h-cpu-powers-tgs-2000-series-stackable-edge-ai-computers/

Intel Core Ultra Series 3 Panther Lake-H CPU powers TGS-2000 series stackable Edge AI computers pack

https://fed.brid.gy/r/https://www.cnx-software.com/2026/01/08/intel-core-ultra-series-3-panther-lake-h-cpu-powers-tgs-2000-series-stackable-edge-ai-computers-pack/

Luxonis OAK4 standalone AI vision camera features Qualcomm QCS8550 SoC with up to 52 TOPS performance

https://fed.brid.gy/r/https://www.cnx-software.com/2025/12/15/luxonis-oak4-standalone-ai-vision-camera-features-qualcomm-qcs8550-soc-with-up-to-52-tops-performance/

UP Xtreme ARL AI Dev Kit review – Benchmarks and AI workloads on an Intel Core Ultra 5 225H Arrow Lake SBC

https://fed.brid.gy/r/https://www.cnx-software.com/2025/12/14/up-xtreme-arl-ai-dev-kit-review-benchmarks-and-ai-workloads-on-an-intel-core-ultra-5-225h-arrow-lake-sbc/

UP Xtreme ARL AI Dev Kit review – Benchmarks and AI workloads on an Intel Core Ultra 5 225H Arrow Lake SBC

https://web.brid.gy/r/https://www.cnx-software.com/2025/12/14/up-xtreme-arl-ai-dev-kit-review-benchmarks-and-ai-workloads-on-an-intel-core-ultra-5-225h-arrow-lake-sbc/

UP Xtreme ARL AI Dev Kit review – Benchmarks and AI workloads on an Intel Core Ultra 5 225H Arrow Lake SBC

https://web.brid.gy/r/https://www.cnx-software.com/2025/12/14/up-xtreme-arl-ai-dev-kit-review-benchmarks-and-ai-workloads-on-an-intel-core-ultra-5-225h-arrow-lake-sbc/

UP Xtreme ARL AI Dev Kit review – Benchmarks and AI workloads on an Intel Core Ultra 5 225H Arrow Lake SBC

https://web.brid.gy/r/https://www.cnx-software.com/2025/12/14/up-xtreme-arl-ai-dev-kit-review-benchmarks-and-ai-workloads-on-an-intel-core-ultra-5-225h-arrow-lake-sbc/

#Ollama #OpenVINO #IntelNPU Người dùng tìm cách kết nối Ollama với OpenVINO (AI inference) trên thiết bị hỗ trợ Intel NPU. Tính năng còn sơ khai, thiếu thông tin cụ thể. Cần chia sẻ kinh nghiệm cài đặt/Docker? #CôngNghệAI #Intel #OllamaVi

https://www.reddit.com/r/ollama/comments/1pho3g7/ollama_openvino/

Fanless AIM101 Edge System Integrates Intel Processor N150 and PCIe AI Accelerator Support

https://fed.brid.gy/r/https://linuxgizmos.com/fanless-aim101-edge-system-integrates-intel-processor-n150-and-pcie-ai-accelerator-support/

Личное облако на Proxmox, нейронки, LLM и embedding

В прошлой статье я описывал как построить сетевую часть самодержавного сервера, пора принести в него что-то отдаленно разумное. Это руководство описывает весь процесс: от подготовки хоста Proxmox и настройки LXC-контейнера до поиска, конвертации и запуска embedding-моделей (на примере BAAI/bge-large-en-v1.5 ) с использованием Intel GPU для работы модели. Но будет легко запустить не одну модель или полноценного чатбота на этой основе. Главное, что будет ясно как использовать даже простое имеющееся железо домашнего сервера для этого.

https://habr.com/ru/articles/967418/

#proxmox #lxc #openvino #ml #gpu_passthrough #embeddings

Личное облако на Proxmox, нейронки, LLM и embedding

В прошлой статье я описывал как построить сетевую часть самодержавного сервера, пора принести в него что-то отдаленно разумное. Это руководство описывает весь процесс: от подготовки хоста Proxmox и настройки LXC-контейнера до поиска, конвертации и запуска embedding-моделей (на примере BAAI/bge-large-en-v1.5 ) с использованием Intel GPU для работы модели. Но будет легко запустить не одну модель или полноценного чатбота на этой основе. Главное, что будет ясно как использовать даже простое имеющееся железо домашнего сервера для этого.

https://habr.com/ru/articles/967418/

#proxmox #lxc #openvino #ml #gpu_passthrough #embeddings

Личное облако на Proxmox, нейронки, LLM и embedding

В прошлой статье я описывал как построить сетевую часть самодержавного сервера, пора принести в него что-то отдаленно разумное. Это руководство описывает весь процесс: от подготовки хоста Proxmox и настройки LXC-контейнера до поиска, конвертации и запуска embedding-моделей (на примере BAAI/bge-large-en-v1.5 ) с использованием Intel GPU для работы модели. Но будет легко запустить не одну модель или полноценного чатбота на этой основе. Главное, что будет ясно как использовать даже простое имеющееся железо домашнего сервера для этого.

https://habr.com/ru/articles/967418/

#proxmox #lxc #openvino #ml #gpu_passthrough #embeddings

UP TWL AI Dev Kit review – Benchmarks, features testing, and AI workloads on Ubuntu 24.04

https://fed.brid.gy/r/https://www.cnx-software.com/2025/11/17/up-twl-ai-dev-kit-review-benchmarks-features-testing-and-ai-workloads-on-ubuntu-24-04/

Ich hab leider nur bei den ersten Recherchen keine bessere Lösung gefunden. Als Nächstes werde ich ein kleineres, spezialisierteres LLM wie granite ausprobieren. Vielleicht bekomme ich das mit #openVINO auch noch für meine Intel-CPU optimiert.

Ich hab leider nur bei den ersten Recherchen keine bessere Lösung gefunden. Als Nächstes werde ich ein kleineres, spezialisierteres LLM wie granite ausprobieren. Vielleicht bekomme ich das mit #openVINO auch noch für meine Intel-CPU optimiert.

Ich hab leider nur bei den ersten Recherchen keine bessere Lösung gefunden. Als Nächstes werde ich ein kleineres, spezialisierteres LLM wie granite ausprobieren. Vielleicht bekomme ich das mit #openVINO auch noch für meine Intel-CPU optimiert.

Ich hab leider nur bei den ersten Recherchen keine bessere Lösung gefunden. Als Nächstes werde ich ein kleineres, spezialisierteres LLM wie granite ausprobieren. Vielleicht bekomme ich das mit #openVINO auch noch für meine Intel-CPU optimiert.

Классификация документов: гайд для обхода граблей

У всех на слуху библейское изречение « отделять зерна от плевел » и его грубый аналог « отделять мух от котлет ». В обычной жизни мы также сталкиваемся с необходимостью разделять схожие предметы. В машинном обучении задача разделить объекты по определенным классам, например, « зерна » и « плевелы », называется классификация . Классификация лежит в основе современных технологий искусственного интеллекта и играет ключевую роль в машинном обучении.

https://habr.com/ru/articles/923828/

#классификация_документов #openvino #spp #bag_of_words

Классификация документов: гайд для обхода граблей

У всех на слуху библейское изречение « отделять зерна от плевел » и его грубый аналог « отделять мух от котлет ». В обычной жизни мы также сталкиваемся с необходимостью разделять схожие предметы. В машинном обучении задача разделить объекты по определенным классам, например, « зерна » и « плевелы », называется классификация . Классификация лежит в основе современных технологий искусственного интеллекта и играет ключевую роль в машинном обучении.

https://habr.com/ru/articles/923828/

#классификация_документов #openvino #spp #bag_of_words

Классификация документов: гайд для обхода граблей

У всех на слуху библейское изречение « отделять зерна от плевел » и его грубый аналог « отделять мух от котлет ». В обычной жизни мы также сталкиваемся с необходимостью разделять схожие предметы. В машинном обучении задача разделить объекты по определенным классам, например, « зерна » и « плевелы », называется классификация . Классификация лежит в основе современных технологий искусственного интеллекта и играет ключевую роль в машинном обучении.

https://habr.com/ru/articles/923828/

#классификация_документов #openvino #spp #bag_of_words

📊 Some of the results from the Audacity OpenVINO Whisper Transcription study:
- 🕒 Average duration per model: Base (5.86s), Small (15.45s), Medium (39.03s), Large-v3 (81.33s).
- 🏅 Top scorer for accuracy: Small model!

🔗 See the complete analysis: https://medium.com/@chribonn/comparing-audacitys-openvino-whisper-transcription-llms-c80c14834c1c
#DataScience #OpenVINO #Whisper #Audacity #TechInsights #TTMO

📊 Some of the results from the Audacity OpenVINO Whisper Transcription study:
- 🕒 Average duration per model: Base (5.86s), Small (15.45s), Medium (39.03s), Large-v3 (81.33s).
- 🏅 Top scorer for accuracy: Small model!

🔗 See the complete analysis: https://medium.com/@chribonn/comparing-audacitys-openvino-whisper-transcription-llms-c80c14834c1c
#DataScience #OpenVINO #Whisper #Audacity #TechInsights #TTMO