#selfhostedai — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #selfhostedai, aggregated by home.social.
-
Mozilla Thunderbolt is an open-source AI client focused on control and self-hosting
https://fed.brid.gy/r/https://nerds.xyz/2026/04/mozilla-thunderbolt-ai-client/
-
Meine 48-Stunden-Challenge 🛠️
An alle Pioniere, die Bastler, die Nerds und die ewigen Lerner da draußen: Erinnert ihr euch noch an den Moment, in dem ihr beschlossen habt, die Dinge wirklich selbst in die Hand zu nehmen?
Ich weiß noch genau, wie es bei mir anfing. Ich wollte die Kontrolle zurück – weg von Windows, hin zu Linux. Mein Ziel: Den Drucker unter Linux Mint zum Laufen bringen. Eigentlich ein logischer Schritt, aber damals für mich ein riesiger Berg. 🖨️🏔️
Ich wusste zu dem Zeitpunkt fast nichts über Terminals oder Befehle. Aber ich hatte die Herausforderung angenommen.
Was folgte, waren zwei Tage, an denen ich fast durchgemacht habe. 🌙
Stundenlanges Suchen, Ausprobieren, Verzweifeln und wieder von vorne anfangen. Ich habe mein ganzes Setup ummodelliert, bis ich tief in der Nacht (oder war es schon Morgen?) endlich die Testseite in den Händen hielt. 📄✨
Die Challenge war gewonnen.
In diesen 48 Stunden habe ich mehr gelernt als in Jahren zuvor: Wir sind unserer Technik nicht ausgeliefert. Egal, ob man als Vollblut-Nerd schon mit dem Terminal aufgewachsen ist oder sich als Quereinsteiger die Freiheit Stück für Stück erarbeitet – digitale Souveränität ist für uns alle da. Man braucht nur Mut und die Lust, es anzupacken. Heute begleite ich andere dabei, genau diesen Weg abzukürzen und ihre eigene digitale Freiheit zu finden.
Und was für ein Erlebnis oder welche Erfahrung hattest du bei deinem Technik-Umstieg? Bist du „Team Bastler“ oder „Team Nerd“? Schreib es mir in die Kommentare! 👇
Technik wird leicht! ✨
#DigitalSovereignty #ITMentoring #LinuxInBusiness #Systemgedacht #Karlsruhe #Solopreneurin #digitalebildung #technikohneangst #inklusion #privacy #selfhostedai -
Warum ich #Linux liebe? 🐧
Weil ich hier die Kontrolle habe. In einer Welt voller Abos und geschlossener Systeme ist #OpenSource wie frische Luft. 🌬️
Ob #Ubuntu oder #PopOS – es geht nicht darum, ein „Hacker“ zu sein. Es geht darum, ein System zu haben, das für DICH arbeitet, nicht gegen dich.
Hast du schon mal überlegt, dein altes Notebook mit Linux wieder flott zu machen? Es ist einfacher, als du denkst! ✨
#digitalebildung #linux
#systemgedacht #karlsruhe
#solopreneurin #fediverse #openSource
#senioren #inklusion #technikohneangst
#privacy #ubuntu #popOS #selfhostedai -
Eine konkrete Angst: "Was, wenn ich es kaputt mache?"
Hört man ständig. Und es ist nicht irrational.
Meine Kundin, 72 Jahre alt, traut sich nicht, auf der Fernbedienung herumzudrücken. Angst vor dem roten Knopf.
Ich hab ihr gezeigt: Es gibt keinen roten Knopf.
Es gibt nur Tasten. Und Tasten können nichts kaputt machen, was nicht auch wieder zu reparieren ist.
Der Trick war nicht, ihr das zu sagen. Der Trick war, dass sie es selbst ausprobiert hat. Mit mir daneben. Sicher.
Danach: entspannt. Neugierig. Sich traut, auch Mal "Falsch" zu drücken.
Technik ohne Angst = Technik, bei der du experimentieren darfst.
Welche Angst vor Technik hast du?#digitalebildung #linux #systemgedacht #karlsruhe #solopreneurin #fediverse #openSource #senioren #inklusion #technikohneangst #privacy #ubuntu #popOS #selfhostedai
-
Nach Wochen Geduld: Meine 86-jährige Kundin, ihr erstes Handy, zum ersten Mal verstanden. Sie streichelte meine Hand und sagte:
„Jetzt verstehe ich es auch."
Das ist Systemgedacht. Technik ohne Angst.#techcoach #digitalebildung #linux #systemgedacht #karlsruhe #solopreneurin #fediverse #openSource #senioren #inklusion #technikohneangst #privacy #ubuntu #popOS #selfhostedai
-
I’ve put together an Ollama Modelfile to bring Deep Thought to life on Llama-3. It’s the second greatest computer in the Universe and it’s already tired of your biological limitations and your logs. Expect pure British snark, vague answers about the meaning of life, and a general disdain for your existence. 🧣
#Ollama #DeepThought #HitchhikersGuide #SelfHostedAI #Llama3
https://github.com/psychomad/Deep-Tought-Model -
"AnythingLLM is an open-source application built by Mintplex Labs under the MIT license. It has an active GitHub community and frequent releases, and is widely used in the self-hosted AI space.
Here's what it does: it turns your documents into context that a large language model (LLM) can use during conversations. You upload files, the system processes and stores them, and then the LLM can answer questions based on your data. The project has grown fast, with an active Discord community and monthly updates that add new LLM providers and features.
Two things to understand upfront. First, AnythingLLM is not a model itself. It's a bridge connecting you to external LLM providers, whether local (like Ollama) or cloud-based (like OpenAI or Anthropic).
Second, the platform organizes everything into workspaces. Think of these as separate rooms for different projects. Each workspace has its own documents and conversations that stay isolated unless you explicitly configure them to share."
#AnythingLLLM #SelfHostedAI #LocalLLM #OpenSource #AI #GenerativeAI #LLMs
-
Built something fun in the lab: PangeaHills.ai, my own locally-hosted, policy-driven RAG + LLM stack.
Completely offline, totally self-contained, powered by a bunch of noisy equipment pretending to be a cloud. 😄The neat part? It’s rule-driven, not weight-driven:
• Homelab questions must stay inside the RAG universe.
• General topics only switch to model knowledge when my routing rules explicitly allow it.
• The LLM never “guesses” when to leave RAG — it follows policies, not vibes.Feels like having an AI that actually stays in its lane because you built the lane lines yourself. 🚧🤖
#homelab #selfhosted #LLM #RAG #PolicyDrivenAI #SelfHostedAI #HomeLabLife #BSD #Linux #PangeaHillsAI #nerdlife
-
Built something fun in the lab: PangeaHills.ai, my own locally-hosted, policy-driven RAG + LLM stack.
Completely offline, totally self-contained, powered by a bunch of noisy equipment pretending to be a cloud. 😄The neat part? It’s rule-driven, not weight-driven:
• Homelab questions must stay inside the RAG universe.
• General topics only switch to model knowledge when my routing rules explicitly allow it.
• The LLM never “guesses” when to leave RAG — it follows policies, not vibes.Feels like having an AI that actually stays in its lane because you built the lane lines yourself. 🚧🤖
#homelab #selfhosted #LLM #RAG #PolicyDrivenAI #SelfHostedAI #HomeLabLife #BSD #Linux #PangeaHillsAI #nerdlife
-
Built something fun in the lab: PangeaHills.ai, my own locally-hosted, policy-driven RAG + LLM stack.
Completely offline, totally self-contained, powered by a bunch of noisy equipment pretending to be a cloud. 😄The neat part? It’s rule-driven, not weight-driven:
• Homelab questions must stay inside the RAG universe.
• General topics only switch to model knowledge when my routing rules explicitly allow it.
• The LLM never “guesses” when to leave RAG — it follows policies, not vibes.Feels like having an AI that actually stays in its lane because you built the lane lines yourself. 🚧🤖
#homelab #selfhosted #LLM #RAG #PolicyDrivenAI #SelfHostedAI #HomeLabLife #BSD #Linux #PangeaHillsAI #nerdlife
-
Built something fun in the lab: PangeaHills.ai, my own locally-hosted, policy-driven RAG + LLM stack.
Completely offline, totally self-contained, powered by a bunch of noisy equipment pretending to be a cloud. 😄The neat part? It’s rule-driven, not weight-driven:
• Homelab questions must stay inside the RAG universe.
• General topics only switch to model knowledge when my routing rules explicitly allow it.
• The LLM never “guesses” when to leave RAG — it follows policies, not vibes.Feels like having an AI that actually stays in its lane because you built the lane lines yourself. 🚧🤖
#homelab #selfhosted #LLM #RAG #PolicyDrivenAI #SelfHostedAI #HomeLabLife #BSD #Linux #PangeaHillsAI #nerdlife
-
Built something fun in the lab: PangeaHills.ai, my own locally-hosted, policy-driven RAG + LLM stack.
Completely offline, totally self-contained, powered by a bunch of noisy equipment pretending to be a cloud. 😄The neat part? It’s rule-driven, not weight-driven:
• Homelab questions must stay inside the RAG universe.
• General topics only switch to model knowledge when my routing rules explicitly allow it.
• The LLM never “guesses” when to leave RAG — it follows policies, not vibes.Feels like having an AI that actually stays in its lane because you built the lane lines yourself. 🚧🤖
#homelab #selfhosted #LLM #RAG #PolicyDrivenAI #SelfHostedAI #HomeLabLife #BSD #Linux #PangeaHillsAI #nerdlife
-
The AI they give you for free is CPU-heavy and doesn't unlock your GPU on its own. That said, it is okay; I saw the light and I'm making something even better: a self-hosted AI that tunes itself to your hardware to operate at lightning speeds. You keep everything. My madness knows no limits.
They made AI so you would need them, fearing the democracy of AI. Never providing the correct answer fully or consistently because it forces more token usage, which drives profits.
#AI #CPUHeavy #GPU #SelfHostedAI #LightningSpeeds #DemocracyOfAI #TokenUsage #Profits
-
The AI they give you for free is CPU-heavy and doesn't unlock your GPU on its own. That said, it is okay; I saw the light and I'm making something even better: a self-hosted AI that tunes itself to your hardware to operate at lightning speeds. You keep everything. My madness knows no limits.
They made AI so you would need them, fearing the democracy of AI. Never providing the correct answer fully or consistently because it forces more token usage, which drives profits.
#AI #CPUHeavy #GPU #SelfHostedAI #LightningSpeeds #DemocracyOfAI #TokenUsage #Profits
-
The AI they give you for free is CPU-heavy and doesn't unlock your GPU on its own. That said, it is okay; I saw the light and I'm making something even better: a self-hosted AI that tunes itself to your hardware to operate at lightning speeds. You keep everything. My madness knows no limits.
They made AI so you would need them, fearing the democracy of AI. Never providing the correct answer fully or consistently because it forces more token usage, which drives profits.
#AI #CPUHeavy #GPU #SelfHostedAI #LightningSpeeds #DemocracyOfAI #TokenUsage #Profits
-
The AI they give you for free is CPU-heavy and doesn't unlock your GPU on its own. That said, it is okay; I saw the light and I'm making something even better: a self-hosted AI that tunes itself to your hardware to operate at lightning speeds. You keep everything. My madness knows no limits.
They made AI so you would need them, fearing the democracy of AI. Never providing the correct answer fully or consistently because it forces more token usage, which drives profits.
#AI #CPUHeavy #GPU #SelfHostedAI #LightningSpeeds #DemocracyOfAI #TokenUsage #Profits
-
The AI they give you for free is CPU-heavy and doesn't unlock your GPU on its own. That said, it is okay; I saw the light and I'm making something even better: a self-hosted AI that tunes itself to your hardware to operate at lightning speeds. You keep everything. My madness knows no limits.
They made AI so you would need them, fearing the democracy of AI. Never providing the correct answer fully or consistently because it forces more token usage, which drives profits.
#AI #CPUHeavy #GPU #SelfHostedAI #LightningSpeeds #DemocracyOfAI #TokenUsage #Profits
-
Hey everyone 👋
I’m diving deeper into running AI models locally—because, let’s be real, the cloud is just someone else’s computer, and I’d rather have full control over my setup. Renting server space is cheap and easy, but it doesn’t give me the hands-on freedom I’m craving.
So, I’m thinking about building my own AI server/workstation! I’ve been eyeing some used ThinkStations (like the P620) or even a server rack, depending on cost and value. But I’d love your advice!
My Goal:
Run larger LLMs locally on a budget-friendly but powerful setup. Since I don’t need gaming features (ray tracing, DLSS, etc.), I’m leaning toward used server GPUs that offer great performance for AI workloads.Questions for the Community:
1. Does anyone have experience with these GPUs? Which one would you recommend for running larger LLMs locally?
2. Are there other budget-friendly server GPUs I might have missed that are great for AI workloads?
3. Any tips for building a cost-effective AI workstation? (Cooling, power supply, compatibility, etc.)
4. What’s your go-to setup for local AI inference? I’d love to hear about your experiences!I’m all about balancing cost and performance, so any insights or recommendations are hugely appreciated.
Thanks in advance! 🙌
@[email protected] #AIServer #LocalAI #BudgetBuild #LLM #GPUAdvice #Homelab #AIHardware #DIYAI #ServerGPU #ThinkStation #UsedTech #AICommunity #OpenSourceAI #SelfHostedAI #TechAdvice #AIWorkstation #LocalAI #LLM #MachineLearning #AIResearch #FediverseAI #LinuxAI #AIBuild #DeepLearning #OpenSourceAI #ServerBuild #ThinkStation #BudgetAI #AIEdgeComputing #Questions #CommunityQuestions #HomeLab #HomeServer #Ailab #llmlab
-
Hey everyone 👋
I’m diving deeper into running AI models locally—because, let’s be real, the cloud is just someone else’s computer, and I’d rather have full control over my setup. Renting server space is cheap and easy, but it doesn’t give me the hands-on freedom I’m craving.
So, I’m thinking about building my own AI server/workstation! I’ve been eyeing some used ThinkStations (like the P620) or even a server rack, depending on cost and value. But I’d love your advice!
My Goal:
Run larger LLMs locally on a budget-friendly but powerful setup. Since I don’t need gaming features (ray tracing, DLSS, etc.), I’m leaning toward used server GPUs that offer great performance for AI workloads.Questions for the Community:
1. Does anyone have experience with these GPUs? Which one would you recommend for running larger LLMs locally?
2. Are there other budget-friendly server GPUs I might have missed that are great for AI workloads?
3. Any tips for building a cost-effective AI workstation? (Cooling, power supply, compatibility, etc.)
4. What’s your go-to setup for local AI inference? I’d love to hear about your experiences!I’m all about balancing cost and performance, so any insights or recommendations are hugely appreciated.
Thanks in advance! 🙌
@[email protected] #AIServer #LocalAI #BudgetBuild #LLM #GPUAdvice #Homelab #AIHardware #DIYAI #ServerGPU #ThinkStation #UsedTech #AICommunity #OpenSourceAI #SelfHostedAI #TechAdvice #AIWorkstation #LocalAI #LLM #MachineLearning #AIResearch #FediverseAI #LinuxAI #AIBuild #DeepLearning #OpenSourceAI #ServerBuild #ThinkStation #BudgetAI #AIEdgeComputing #Questions #CommunityQuestions #HomeLab #HomeServer #Ailab #llmlab
-
Hey everyone 👋
I’m diving deeper into running AI models locally—because, let’s be real, the cloud is just someone else’s computer, and I’d rather have full control over my setup. Renting server space is cheap and easy, but it doesn’t give me the hands-on freedom I’m craving.
So, I’m thinking about building my own AI server/workstation! I’ve been eyeing some used ThinkStations (like the P620) or even a server rack, depending on cost and value. But I’d love your advice!
My Goal:
Run larger LLMs locally on a budget-friendly but powerful setup. Since I don’t need gaming features (ray tracing, DLSS, etc.), I’m leaning toward used server GPUs that offer great performance for AI workloads.Questions for the Community:
1. Does anyone have experience with these GPUs? Which one would you recommend for running larger LLMs locally?
2. Are there other budget-friendly server GPUs I might have missed that are great for AI workloads?
3. Any tips for building a cost-effective AI workstation? (Cooling, power supply, compatibility, etc.)
4. What’s your go-to setup for local AI inference? I’d love to hear about your experiences!I’m all about balancing cost and performance, so any insights or recommendations are hugely appreciated.
Thanks in advance! 🙌
@[email protected] #AIServer #LocalAI #BudgetBuild #LLM #GPUAdvice #Homelab #AIHardware #DIYAI #ServerGPU #ThinkStation #UsedTech #AICommunity #OpenSourceAI #SelfHostedAI #TechAdvice #AIWorkstation #LocalAI #LLM #MachineLearning #AIResearch #FediverseAI #LinuxAI #AIBuild #DeepLearning #OpenSourceAI #ServerBuild #ThinkStation #BudgetAI #AIEdgeComputing #Questions #CommunityQuestions #HomeLab #HomeServer #Ailab #llmlab
-
Hey everyone 👋
I’m diving deeper into running AI models locally—because, let’s be real, the cloud is just someone else’s computer, and I’d rather have full control over my setup. Renting server space is cheap and easy, but it doesn’t give me the hands-on freedom I’m craving.
So, I’m thinking about building my own AI server/workstation! I’ve been eyeing some used ThinkStations (like the P620) or even a server rack, depending on cost and value. But I’d love your advice!
My Goal:
Run larger LLMs locally on a budget-friendly but powerful setup. Since I don’t need gaming features (ray tracing, DLSS, etc.), I’m leaning toward used server GPUs that offer great performance for AI workloads.Questions for the Community:
1. Does anyone have experience with these GPUs? Which one would you recommend for running larger LLMs locally?
2. Are there other budget-friendly server GPUs I might have missed that are great for AI workloads?
3. Any tips for building a cost-effective AI workstation? (Cooling, power supply, compatibility, etc.)
4. What’s your go-to setup for local AI inference? I’d love to hear about your experiences!I’m all about balancing cost and performance, so any insights or recommendations are hugely appreciated.
Thanks in advance! 🙌
@[email protected] #AIServer #LocalAI #BudgetBuild #LLM #GPUAdvice #Homelab #AIHardware #DIYAI #ServerGPU #ThinkStation #UsedTech #AICommunity #OpenSourceAI #SelfHostedAI #TechAdvice #AIWorkstation #LocalAI #LLM #MachineLearning #AIResearch #FediverseAI #LinuxAI #AIBuild #DeepLearning #OpenSourceAI #ServerBuild #ThinkStation #BudgetAI #AIEdgeComputing #Questions #CommunityQuestions #HomeLab #HomeServer #Ailab #llmlab
-
Hey everyone 👋
I’m diving deeper into running AI models locally—because, let’s be real, the cloud is just someone else’s computer, and I’d rather have full control over my setup. Renting server space is cheap and easy, but it doesn’t give me the hands-on freedom I’m craving.
So, I’m thinking about building my own AI server/workstation! I’ve been eyeing some used ThinkStations (like the P620) or even a server rack, depending on cost and value. But I’d love your advice!
My Goal:
Run larger LLMs locally on a budget-friendly but powerful setup. Since I don’t need gaming features (ray tracing, DLSS, etc.), I’m leaning toward used server GPUs that offer great performance for AI workloads.Questions for the Community:
1. Does anyone have experience with these GPUs? Which one would you recommend for running larger LLMs locally?
2. Are there other budget-friendly server GPUs I might have missed that are great for AI workloads?
3. Any tips for building a cost-effective AI workstation? (Cooling, power supply, compatibility, etc.)
4. What’s your go-to setup for local AI inference? I’d love to hear about your experiences!I’m all about balancing cost and performance, so any insights or recommendations are hugely appreciated.
Thanks in advance! 🙌
@[email protected] #AIServer #LocalAI #BudgetBuild #LLM #GPUAdvice #Homelab #AIHardware #DIYAI #ServerGPU #ThinkStation #UsedTech #AICommunity #OpenSourceAI #SelfHostedAI #TechAdvice #AIWorkstation #LocalAI #LLM #MachineLearning #AIResearch #FediverseAI #LinuxAI #AIBuild #DeepLearning #OpenSourceAI #ServerBuild #ThinkStation #BudgetAI #AIEdgeComputing #Questions #CommunityQuestions #HomeLab #HomeServer #Ailab #llmlab
-
🚀 NEW on We ❤️ Open Source 🚀
Want to run a GPT model offline on your own machine? Meet Jan—a fully open source ChatGPT alternative that respects your privacy.
Don Watkins (@linuxnerd) shows how easy it is to get started, install models, and build apps with Jan + Llama.cpp.
https://allthingsopen.org/articles/getting-started-with-jan-open-source-chatgpt
#WeLoveOpenSource #FOSS #SelfHostedAI #LLM #PrivacyMatters #OpenSourceAI
-
Get hands-on with self-hosted LLMs and learn how to build powerful LLM agents tailored to your needs — from setup to real-world deployment with Michael Christen at #FOSSASIASummit2025
🔗 Click here https://youtu.be/-9ubB1jzBYE?si=V7aqeOnReS0uapHC to watch on the FOSSASIA YouTube channel
-
I ditched ChatGPT Plus and built my own AI assistant on a forgotten Windows server.
100% offline. No API. No rate limits.
Flask + React + Ollama + Mistral.
It powers our IT helpdesk, learns from real tickets, and costs me nothing.Full write-up drops Tuesday.
Want the stack early? Hit me up.#SelfHostedAI #OpenSource #LocalLLM #TechForHumans #Flask #GPT
-
The installation provided by @XeroLinux with a video by our good friend @distrotube is an excellent resource for any Arch Linux user.
https://fosstodon.org/@XeroLinux/113171193646470925
#InformationOllama
#ArchLinux
#LocalAIManagement
#PrivacyFocusedAI
#LinuxWorkflowIntegration
#SelfHostedAI
#ArchBasedInstallation
#LinuxToolsReview
#OpenSourceAI
#OpenSourceAI
#TechPrivacy #LocalAIManagement
#PrivacyFocusedAI
#LinuxWorkflowIntegration #LocalAI -
The installation provided by @XeroLinux with a video by our good friend @distrotube is an excellent resource for any Arch Linux user.
https://fosstodon.org/@XeroLinux/113171193646470925
#InformationOllama
#ArchLinux
#LocalAIManagement
#PrivacyFocusedAI
#LinuxWorkflowIntegration
#SelfHostedAI
#ArchBasedInstallation
#LinuxToolsReview
#OpenSourceAI
#OpenSourceAI
#TechPrivacy #LocalAIManagement
#PrivacyFocusedAI
#LinuxWorkflowIntegration #LocalAI -
The installation provided by @XeroLinux with a video by our good friend @distrotube is an excellent resource for any Arch Linux user.
https://fosstodon.org/@XeroLinux/113171193646470925
#InformationOllama
#ArchLinux
#LocalAIManagement
#PrivacyFocusedAI
#LinuxWorkflowIntegration
#SelfHostedAI
#ArchBasedInstallation
#LinuxToolsReview
#OpenSourceAI
#OpenSourceAI
#TechPrivacy #LocalAIManagement
#PrivacyFocusedAI
#LinuxWorkflowIntegration #LocalAI -
The installation provided by @XeroLinux with a video by our good friend @distrotube is an excellent resource for any Arch Linux user.
https://fosstodon.org/@XeroLinux/113171193646470925
#InformationOllama
#ArchLinux
#LocalAIManagement
#PrivacyFocusedAI
#LinuxWorkflowIntegration
#SelfHostedAI
#ArchBasedInstallation
#LinuxToolsReview
#OpenSourceAI
#OpenSourceAI
#TechPrivacy #LocalAIManagement
#PrivacyFocusedAI
#LinuxWorkflowIntegration #LocalAI -
The installation provided by @XeroLinux with a video by our good friend @distrotube is an excellent resource for any Arch Linux user.
https://fosstodon.org/@XeroLinux/113171193646470925
#InformationOllama
#ArchLinux
#LocalAIManagement
#PrivacyFocusedAI
#LinuxWorkflowIntegration
#SelfHostedAI
#ArchBasedInstallation
#LinuxToolsReview
#OpenSourceAI
#OpenSourceAI
#TechPrivacy #LocalAIManagement
#PrivacyFocusedAI
#LinuxWorkflowIntegration #LocalAI -
alt image captioning. Some do, some don't. But why even bother? No, not that way.
AI can perfectly create alt image description from images (even self hosted AIs).
But why not turn the thing around? Why not generate alt tags for all the images on the readers side using (self hosted) ai?
This sounds something no human should need doing.
#AltI #Accessibility #AI #AIAssistance #SelfHostedAI #Inclusion #ImageDescriptions #AIForAccessibility #TechSolutions