#janai — Public Fediverse posts

So, I’ve been re-evaluating my local #LLM #AI implementation on my computer…and I’m realizing that I never configured #JanAI to use my #GPU! Now responses are way faster, so I’ll probably go out and get a more powerful model from #Huggingface.

So, I’ve been re-evaluating my local #LLM #AI implementation on my computer…and I’m realizing that I never configured #JanAI to use my #GPU! Now responses are way faster, so I’ll probably go out and get a more powerful model from #Huggingface.

So, I’ve been re-evaluating my local #LLM #AI implementation on my computer…and I’m realizing that I never configured #JanAI to use my #GPU! Now responses are way faster, so I’ll probably go out and get a more powerful model from #Huggingface.

BTW, these are the #AI #LLM models I settled on using with #JanAI:

#Qwen2.5 at 0.5B (Qwen2_5-0_5B-Instruct-uncensored_Q8_0), for fastest performance on low-end hardware

#Qwen2 at 1.5B (Qwen2-1_5B-Instruct-Abliterated-Q5_K_M), for balanced performance and good enough output quality

#Llama3.2 at 3B (Llama-3_2-3B-Instruct-heretic-ablitered-uncensored_Q5_K_M), for higher quality output

#Llama3 actually doesn’t run too poorly on my machine, although it can take some time to load up responses sometimes.

BTW, these are the #AI #LLM models I settled on using with #JanAI:

#Qwen2.5 at 0.5B (Qwen2_5-0_5B-Instruct-uncensored_Q8_0), for fastest performance on low-end hardware

#Qwen2 at 1.5B (Qwen2-1_5B-Instruct-Abliterated-Q5_K_M), for balanced performance and good enough output quality

#Llama3.2 at 3B (Llama-3_2-3B-Instruct-heretic-ablitered-uncensored_Q5_K_M), for higher quality output

#Llama3 actually doesn’t run too poorly on my machine, although it can take some time to load up responses sometimes.

BTW, these are the #AI #LLM models I settled on using with #JanAI:

#Qwen2.5 at 0.5B (Qwen2_5-0_5B-Instruct-uncensored_Q8_0), for fastest performance on low-end hardware

#Qwen2 at 1.5B (Qwen2-1_5B-Instruct-Abliterated-Q5_K_M), for balanced performance and good enough output quality

#Llama3.2 at 3B (Llama-3_2-3B-Instruct-heretic-ablitered-uncensored_Q5_K_M), for higher quality output

#Llama3 actually doesn’t run too poorly on my machine, although it can take some time to load up responses sometimes.

More Memeteria. Thomas May reviews the Seattle Firebird and it comes out Poulenc's Stabat Mater. We saw this concert last night and the Poulenc, and breathtaking Soprano Janai Brugger.
#SeattleSymphony #FrancisPoulenc #StabatMater #Firebirdsuite
#Janai Brugger
https://memeteria.com/2026/03/22/firebird-fever-in-seattle-with-hard-hitting-poulenc/

More Memeteria. Thomas May reviews the Seattle Firebird and it comes out Poulenc's Stabat Mater. We saw this concert last night and the Poulenc, and breathtaking Soprano Janai Brugger.
#SeattleSymphony #FrancisPoulenc #StabatMater #Firebirdsuite
#Janai Brugger
https://memeteria.com/2026/03/22/firebird-fever-in-seattle-with-hard-hitting-poulenc/

More Memeteria. Thomas May reviews the Seattle Firebird and it comes out Poulenc's Stabat Mater. We saw this concert last night and the Poulenc, and breathtaking Soprano Janai Brugger.
#SeattleSymphony #FrancisPoulenc #StabatMater #Firebirdsuite
#Janai Brugger
https://memeteria.com/2026/03/22/firebird-fever-in-seattle-with-hard-hitting-poulenc/

More Memeteria. Thomas May reviews the Seattle Firebird and it comes out Poulenc's Stabat Mater. We saw this concert last night and the Poulenc, and breathtaking Soprano Janai Brugger.
#SeattleSymphony #FrancisPoulenc #StabatMater #Firebirdsuite
#Janai Brugger
https://memeteria.com/2026/03/22/firebird-fever-in-seattle-with-hard-hitting-poulenc/

Having fun with #AI so far.

#JanAI #Qwen #Qwen2 #LLM #FOSS

Having fun with #AI so far.

#JanAI #Qwen #Qwen2 #LLM #FOSS

Having fun with #AI so far.

#JanAI #Qwen #Qwen2 #LLM #FOSS

@marvin Well, I tried using #LMStudio and #JanAI and as a first step, I need to download models. I fully understand that, but the list of models is so long, so cryptic. At least to me. I don't even know where to start to get assistance on fine-tuning ma #LaTeX code or some #bash scripts...

Jan, GPT, Ernie, Olmo, Lucy, Llama, Mistral, ... And then for a given model, stuff like Qwen3-8B-GGUF.

This being said, I work with a laptop. Powerful CPU and RAM but no big GPU... My experiment might not be worth it?

Thanks a lot for your reponse 🙂

@marvin Well, I tried using #LMStudio and #JanAI and as a first step, I need to download models. I fully understand that, but the list of models is so long, so cryptic. At least to me. I don't even know where to start to get assistance on fine-tuning ma #LaTeX code or some #bash scripts...

Jan, GPT, Ernie, Olmo, Lucy, Llama, Mistral, ... And then for a given model, stuff like Qwen3-8B-GGUF.

This being said, I work with a laptop. Powerful CPU and RAM but no big GPU... My experiment might not be worth it?

Thanks a lot for your reponse 🙂

@marvin Well, I tried using #LMStudio and #JanAI and as a first step, I need to download models. I fully understand that, but the list of models is so long, so cryptic. At least to me. I don't even know where to start to get assistance on fine-tuning ma #LaTeX code or some #bash scripts...

Jan, GPT, Ernie, Olmo, Lucy, Llama, Mistral, ... And then for a given model, stuff like Qwen3-8B-GGUF.

This being said, I work with a laptop. Powerful CPU and RAM but no big GPU... My experiment might not be worth it?

Thanks a lot for your reponse 🙂

@marvin Well, I tried using #LMStudio and #JanAI and as a first step, I need to download models. I fully understand that, but the list of models is so long, so cryptic. At least to me. I don't even know where to start to get assistance on fine-tuning ma #LaTeX code or some #bash scripts...

Jan, GPT, Ernie, Olmo, Lucy, Llama, Mistral, ... And then for a given model, stuff like Qwen3-8B-GGUF.

This being said, I work with a laptop. Powerful CPU and RAM but no big GPU... My experiment might not be worth it?

Thanks a lot for your reponse 🙂

@marvin Well, I tried using #LMStudio and #JanAI and as a first step, I need to download models. I fully understand that, but the list of models is so long, so cryptic. At least to me. I don't even know where to start to get assistance on fine-tuning ma #LaTeX code or some #bash scripts...

Jan, GPT, Ernie, Olmo, Lucy, Llama, Mistral, ... And then for a given model, stuff like Qwen3-8B-GGUF.

This being said, I work with a laptop. Powerful CPU and RAM but no big GPU... My experiment might not be worth it?

Thanks a lot for your reponse 🙂

Người dùng Reddit báo cáo Jan.ai không nhận diện GPU AMD RX 9070 XT. Họ đã thử, kèm ảnh chụp màn hình cho thấy GPU không được phát hiện và hỏi cách khắc phục. Cần hỗ trợ cấu hình hoặc giải pháp tương thích. #JanAI #AMD #GPU #AI #Tech #CôngNghệ #LocalLLaMA #AI #GPU 🚀

https://www.reddit.com/r/LocalLLaMA/comments/1qk27xm/janai_и_rx_9070xt/

Jan cập nhật v0.7.5 với tiện ích trình duyệt Jan Browser MCP, hỗ trợ đính kèm tệp tin và Flatpak dành cho Linux! Người dùng Chrome có thể cài tiện ích từ Chrome Web Store để tăng tính ổn định khi lướt web. Đồng thời, Linux users cuối cùng được hỗ trợ Flatpak. [Kèm video hướng dẫn chi tiết]. Những cải tiến này giúp trải nghiệm chat và tương tác trở nên thuận tiện hơn. Tìm hiểu thêm tại Flathub hoặc GitHub.

#LocalLLaMA #Jan #AI #PhầnMềmMới #Linux #CôngNghệ
#JanAI #BrowserExtension #FileSuppor

Cập nhật thủ công llama.cpp đến phiên bản mới nhất qua Jan.ai! 🚀 #llamaCPP #JanAI #CôngTec #CậpNhệSin → Bruxelles: #llamaCPP #JanAI #AI #Update

https://www.reddit.com/r/LocalLLaMA/comments/1o85j8t/manually_update_to_the_latest_version_of_llamacpp/

Vulnerabilities Expose Jan AI Systems to Remote Manipulation – Source: www.securityweek.com https://ciso2ciso.com/vulnerabilities-expose-jan-ai-systems-to-remote-manipulation-source-www-securityweek-com/ #rssfeedpostgeneratorecho #ArtificialIntelligence #CyberSecurityNews #securityweekcom #securityweek #genai #JanAI #AI

Vulnerabilities Expose Jan AI Systems to Remote Manipulation – Source: www.securityweek.com https://ciso2ciso.com/vulnerabilities-expose-jan-ai-systems-to-remote-manipulation-source-www-securityweek-com/ #rssfeedpostgeneratorecho #ArtificialIntelligence #CyberSecurityNews #securityweekcom #securityweek #genai #JanAI #AI

Vulnerabilities Expose Jan AI Systems to Remote Manipulation – Source: www.securityweek.com https://ciso2ciso.com/vulnerabilities-expose-jan-ai-systems-to-remote-manipulation-source-www-securityweek-com/ #rssfeedpostgeneratorecho #ArtificialIntelligence #CyberSecurityNews #securityweekcom #securityweek #genai #JanAI #AI

Vulnerabilities Expose Jan AI Systems to Remote Manipulation – Source: www.securityweek.com https://ciso2ciso.com/vulnerabilities-expose-jan-ai-systems-to-remote-manipulation-source-www-securityweek-com/ #rssfeedpostgeneratorecho #ArtificialIntelligence #CyberSecurityNews #securityweekcom #securityweek #genai #JanAI #AI

Vulnerabilities Expose Jan AI Systems to Remote Manipulation https://www.securityweek.com/vulnerabilities-expose-jan-ai-systems-to-remote-manipulation/ #ArtificialIntelligence #Gen-AI #JanAI #AI

Vulnerabilities Expose Jan AI Systems to Remote Manipulation https://www.securityweek.com/vulnerabilities-expose-jan-ai-systems-to-remote-manipulation/ #ArtificialIntelligence #Gen-AI #JanAI #AI

Vulnerabilities Expose Jan AI Systems to Remote Manipulation https://www.securityweek.com/vulnerabilities-expose-jan-ai-systems-to-remote-manipulation/ #ArtificialIntelligence #Gen-AI #JanAI #AI

Vulnerabilities Expose Jan AI Systems to Remote Manipulation https://www.securityweek.com/vulnerabilities-expose-jan-ai-systems-to-remote-manipulation/ #ArtificialIntelligence #Gen-AI #JanAI #AI

起初 #LmStudio 對Linux支持一般，所以一直在用 #JanAi 但現在支持得很好了，在Linux上面也有 CPU/Vulkan/CUDDA 三種backend，雖然Vulkan速度一般但至少amd卡也能用

Haluatko ajaa tekoälymalleja suoraan omalla tietokoneellasi ilman, että tietosi lähtevät mihinkään? Tässä videossa näytän yksinkertaisimman tavan asentaa ja käyttää paikallisia tekoälyjä, mukaan lukien DeepSeek ja Llama-mallit. Käyn läpi lataamisen, asentamisen ja mallien käyttämisen sekä puhumme hieman siitä miten hyvin ne toimivat. 👉 https://youtu.be/VZrQc_EbFao

Katso video ja testaa itse!

#tekoäly #deepseek #janai #Llama3 #tietosuoja
https://youtu.be/VZrQc_EbFao

Haluatko ajaa tekoälymalleja suoraan omalla tietokoneellasi ilman, että tietosi lähtevät mihinkään? Tässä videossa näytän yksinkertaisimman tavan asentaa ja käyttää paikallisia tekoälyjä, mukaan lukien DeepSeek ja Llama-mallit. Käyn läpi lataamisen, asentamisen ja mallien käyttämisen sekä puhumme hieman siitä miten hyvin ne toimivat. 👉 https://youtu.be/VZrQc_EbFao

Katso video ja testaa itse!

#tekoäly #deepseek #janai #Llama3 #tietosuoja
https://youtu.be/VZrQc_EbFao

Haluatko ajaa tekoälymalleja suoraan omalla tietokoneellasi ilman, että tietosi lähtevät mihinkään? Tässä videossa näytän yksinkertaisimman tavan asentaa ja käyttää paikallisia tekoälyjä, mukaan lukien DeepSeek ja Llama-mallit. Käyn läpi lataamisen, asentamisen ja mallien käyttämisen sekä puhumme hieman siitä miten hyvin ne toimivat. 👉 https://youtu.be/VZrQc_EbFao

Katso video ja testaa itse!

#tekoäly #deepseek #janai #Llama3 #tietosuoja
https://youtu.be/VZrQc_EbFao

Haluatko ajaa tekoälymalleja suoraan omalla tietokoneellasi ilman, että tietosi lähtevät mihinkään? Tässä videossa näytän yksinkertaisimman tavan asentaa ja käyttää paikallisia tekoälyjä, mukaan lukien DeepSeek ja Llama-mallit. Käyn läpi lataamisen, asentamisen ja mallien käyttämisen sekä puhumme hieman siitä miten hyvin ne toimivat. 👉 https://youtu.be/VZrQc_EbFao

Katso video ja testaa itse!

#tekoäly #deepseek #janai #Llama3 #tietosuoja
https://youtu.be/VZrQc_EbFao

5/ Jan AI: Offers a user-friendly interface and runs on multiple OS. Known for its elegant and clean UI. #JanAI #AI #LocalLLM jan.ai

Turn your computer into an AI ...

5/ Jan AI: Offers a user-friendly interface and runs on multiple OS. Known for its elegant and clean UI. #JanAI #AI #LocalLLM
https://jan.ai/

5/ Jan AI: Offers a user-friendly interface and runs on multiple OS. Known for its elegant and clean UI. #JanAI #AI #LocalLLM
https://jan.ai/

5/ Jan AI: Offers a user-friendly interface and runs on multiple OS. Known for its elegant and clean UI. #JanAI #AI #LocalLLM
https://jan.ai/

5/ Jan AI: Offers a user-friendly interface and runs on multiple OS. Known for its elegant and clean UI. #JanAI #AI #LocalLLM
https://jan.ai/

5/ Jan AI: Offers a user-friendly interface and runs on multiple OS. Known for its elegant and clean UI. #JanAI #AI #LocalLLM
https://jan.ai/

Quitte à utiliser un modèle de langage étendu ( #LLM ) tel que #ChatGPT , autant que celui-ci soit, contrairement à #ChatGPT :

* #OpenSource #foss
* installable localement
* aussi compétent, mais plus léger
* made in #france #Europe

Utilisez #MistralAI #OpenSource #foss #france #AI avec l'interface #JanAI #OpenSource

https://blog.zenika.com/2024/02/29/mistral-ai-presentation-et-utilisation-du-modele-dans-le-vent/

Quitte à utiliser un modèle de langage étendu ( #LLM ) tel que #ChatGPT , autant que celui-ci soit, contrairement à #ChatGPT :

* #OpenSource #foss
* installable localement
* aussi compétent, mais plus léger
* made in #france #Europe

Utilisez #MistralAI #OpenSource #foss #france #AI avec l'interface #JanAI #OpenSource

https://blog.zenika.com/2024/02/29/mistral-ai-presentation-et-utilisation-du-modele-dans-le-vent/

Quitte à utiliser un modèle de langage étendu ( #LLM ) tel que #ChatGPT , autant que celui-ci soit, contrairement à #ChatGPT :

* #OpenSource #foss
* installable localement
* aussi compétent, mais plus léger
* made in #france #Europe

Utilisez #MistralAI #OpenSource #foss #france #AI avec l'interface #JanAI #OpenSource

https://blog.zenika.com/2024/02/29/mistral-ai-presentation-et-utilisation-du-modele-dans-le-vent/

Quitte à utiliser un modèle de langage étendu ( #LLM ) tel que #ChatGPT , autant que celui-ci soit, contrairement à #ChatGPT :

* #OpenSource #foss
* installable localement
* aussi compétent, mais plus léger
* made in #france #Europe

Utilisez #MistralAI #OpenSource #foss #france #AI avec l'interface #JanAI #OpenSource

https://blog.zenika.com/2024/02/29/mistral-ai-presentation-et-utilisation-du-modele-dans-le-vent/

Quitte à utiliser un modèle de langage étendu ( #LLM ) tel que #ChatGPT , autant que celui-ci soit, contrairement à #ChatGPT :

* #OpenSource #foss
* installable localement
* aussi compétent, mais plus léger
* made in #france #Europe

Utilisez #MistralAI #OpenSource #foss #france #AI avec l'interface #JanAI #OpenSource

https://blog.zenika.com/2024/02/29/mistral-ai-presentation-et-utilisation-du-modele-dans-le-vent/