Giving AnythingLLM another chance! I've loaded Qwen3-4B-Q5_K_M and fed it a 500-page book on industrial automation and PLCs via RAG. Responses take around 30 seconds. There's still a lot of work to get reliable results, and I'm experimenting with different prompts. Heavier models aren't an option with my hardware, so I'll have to make this one work!
#anythingllm — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #anythingllm, aggregated by home.social.