#servergoblin — Public Fediverse posts

Another RAG-to-Riches story.
…ok, not really — I’m just an average homelab goblin who accidentally reinvented a thing the real AI folks probably solved 3 years ago. 😂

But I call it policy-driven RAG:
where rules, not model weights, decide when my local LLM answers from the doc corpus and when it’s allowed to use general knowledge.

Basically:
“Stay in your lane unless I say otherwise.”
RAG for homelab stuff
LLM for the wider world
Never phones home

Might be old hat to the pros, but it absolutely blew my geek mind that it actually works.

Just a homelab nerd living his best offline-AI life.

#homelab #LocalAI #RAG #SelfHosted #PangeaHillsAI #LLM #NerdLife #ServerGoblin #ComputersAreFun

Another RAG-to-Riches story.
…ok, not really — I’m just an average homelab goblin who accidentally reinvented a thing the real AI folks probably solved 3 years ago. 😂

But I call it policy-driven RAG:
where rules, not model weights, decide when my local LLM answers from the doc corpus and when it’s allowed to use general knowledge.

Basically:
“Stay in your lane unless I say otherwise.”
RAG for homelab stuff
LLM for the wider world
Never phones home

Might be old hat to the pros, but it absolutely blew my geek mind that it actually works.

Just a homelab nerd living his best offline-AI life.

#homelab #LocalAI #RAG #SelfHosted #PangeaHillsAI #LLM #NerdLife #ServerGoblin #ComputersAreFun

Another RAG-to-Riches story.
…ok, not really — I’m just an average homelab goblin who accidentally reinvented a thing the real AI folks probably solved 3 years ago. 😂

But I call it policy-driven RAG:
where rules, not model weights, decide when my local LLM answers from the doc corpus and when it’s allowed to use general knowledge.

Basically:
“Stay in your lane unless I say otherwise.”
RAG for homelab stuff
LLM for the wider world
Never phones home

Might be old hat to the pros, but it absolutely blew my geek mind that it actually works.

Just a homelab nerd living his best offline-AI life.

#homelab #LocalAI #RAG #SelfHosted #PangeaHillsAI #LLM #NerdLife #ServerGoblin #ComputersAreFun

Another RAG-to-Riches story.
…ok, not really — I’m just an average homelab goblin who accidentally reinvented a thing the real AI folks probably solved 3 years ago. 😂

But I call it policy-driven RAG:
where rules, not model weights, decide when my local LLM answers from the doc corpus and when it’s allowed to use general knowledge.

Basically:
“Stay in your lane unless I say otherwise.”
RAG for homelab stuff
LLM for the wider world
Never phones home

Might be old hat to the pros, but it absolutely blew my geek mind that it actually works.

Just a homelab nerd living his best offline-AI life.

#homelab #LocalAI #RAG #SelfHosted #PangeaHillsAI #LLM #NerdLife #ServerGoblin #ComputersAreFun

Another RAG-to-Riches story.
…ok, not really — I’m just an average homelab goblin who accidentally reinvented a thing the real AI folks probably solved 3 years ago. 😂

But I call it policy-driven RAG:
where rules, not model weights, decide when my local LLM answers from the doc corpus and when it’s allowed to use general knowledge.

Basically:
“Stay in your lane unless I say otherwise.”
RAG for homelab stuff
LLM for the wider world
Never phones home

Might be old hat to the pros, but it absolutely blew my geek mind that it actually works.

Just a homelab nerd living his best offline-AI life.

#homelab #LocalAI #RAG #SelfHosted #PangeaHillsAI #LLM #NerdLife #ServerGoblin #ComputersAreFun