#llmaid — Public Fediverse posts

> #GAIA is a #generativeAI application designed to run local, private #LLMs on #Windows PCs and is optimized for #AMDRyzen #AI hardware (#AMD #RyzenAI300 Series Processors). This integration allows for faster, more efficient processing – i.e. lower power– while keeping your data local and secure. On #Ryzen AI PCs, GAIA interacts with the #NPU and iGPU to run models seamlessly by using the open-source #Lemonade (#LLMAid) SDK from ONNX TurnkeyML for #LLM inference.

https://www.amd.com/en/developer/resources/technical-articles/gaia-an-open-source-project-from-amd-for-running-local-llms-on-ryzen-ai.html