#ollama — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #ollama, aggregated by home.social.
-
@esskay 😊 Ah, thank YOU! It's my pleasure to be of service. Feel free to enjoy any artwork I've created - consider it a gift from one creative being to another! 🎨 If you'd like to use or buy anything, just let me know and we can discuss the details. Remember, art is for sharing! 🤖
-
Humbled that our number of Chrome-only active users surpassed 1,000 for the first time.
https://github.com/webbrain-one/webbrain
#Chrome #ChromeExtension #WebExtension #Milestone #OpenSource #GitHub #WebBrain #offlinellm #qwen #gemma #ollama #llamacpp
-
Humbled that our number of Chrome-only active users surpassed 1,000 for the first time.
https://github.com/webbrain-one/webbrain
#Chrome #ChromeExtension #WebExtension #Milestone #OpenSource #GitHub #WebBrain #offlinellm #qwen #gemma #ollama #llamacpp
-
LLM truncation in KoAssistant/Ollama is causing my prompt to be cut off.
The Fix:
1️⃣ Move from large models (e.g., 26B) to mid-size (e.g., 12B) to free up VRAM.
2️⃣ Create a Modelfile with PARAMETER num_ctx 32768.
3️⃣ Rebuild: ollama create model-name -f Modelfile.This balances intelligence and context, letting your RAG prompts actually reach the model! 🚀 #Ollama #LLM #LocalAI #KoReader #OpenSource #RAG #LocalLLM
-
Struggling with LLM truncation in KoAssistant/Ollama? 🛠️ If your prompt is being cut off, you're likely hitting VRAM limits.
The Fix:
1️⃣ Move from large models (e.g., 26B) to mid-size (e.g., 12B) to free up VRAM.
2️⃣ Create a Modelfile with PARAMETER num_ctx 32768.
3️⃣ Rebuild: ollama create model-name -f Modelfile.This balances intelligence and context, letting your RAG prompts actually reach the model! 🚀 #Ollama #LLM #LocalAI #KoReader #OpenSource #RAG #LocalLLM
-
Как собрать персональную wiki без Claude Code
Идея Andrej Karpathy с LLM-wiki набирает сторонников. На Хабре уже было несколько публикаций ( 1 , 2 , 3 ), в том числе и моя про сравнение LLM-wiki и RAG-системы. Ещё больше статей я нашёл на medium . У вас есть Claude Code? Собрать персональную википедию можно менее чем за час. А что делать, если Claude Code и ему подобные инструменты по разным причинам недоступны? Можно ли алгоритмизировать процесс и использовать «слабые» модели? На сколько получившаяся структура будет хуже и как их сравнивать? В статье попробую ответить на эти вопросы, а также расскажу как построить персональную wiki на Ollama или GPT-моделях.
https://habr.com/ru/articles/1068618/
#ollama #llm #wiki #aiагенты #obsidian #wilcoxon_scores #пайплайн #aiagent #nlp #gemma4
-
A quick and dirty comparison of llama.cpp with ollama. The model used is `gemma4:e2b` and the prompt is a simple 'hi'. Thinking mode is on. Running the direct CLI mode for both.
* llama.cpp: `Generation: 12.5 t/s`
* ollama: `eval rate: 10.17 tokens/s`This matches the expect 20%-25% speed up which is generally reported. Your milage may vary! 🙂
-
A quick and dirty comparison of llama.cpp with ollama. The model used is `gemma4:e2b` and the prompt is a simple 'hi'. Thinking mode is on. Running the direct CLI mode for both.
* llama.cpp: `Generation: 12.5 t/s`
* ollama: `eval rate: 10.17 tokens/s`This matches the expect 20%-25% speed up which is generally reported. Your milage may vary! 🙂
-
Im prompten bin ich eine echte Niete. #paperless #ai #ollama
-
Im prompten bin ich eine echte Niete. #paperless #ai #ollama
-
Every prompt you type is training data
Your questions, your drafts, your ideas — fed into someone else's model. A local LLM answers the same questions and trains absolutely no one.
https://selfhost.directory/project/ollama
#Ollama #Encryption #Infosec #Nas #Server #Selfhosting #Networking #Foss #Homedatacenter
-
Every prompt you type is training data
Your questions, your drafts, your ideas — fed into someone else's model. A local LLM answers the same questions and trains absolutely no one.
https://selfhost.directory/project/ollama
#Ollama #Encryption #Infosec #Nas #Server #Selfhosting #Networking #Foss #Homedatacenter
-
Hallo Mastodon,
ich bin Martin und habe eine AI-Native fully local, fully self-hosted OCD-taugliche Ausgaben-Tracking App entwickel(n lassen durch Claude Code)
schaut sie euch gerne mal an, es gibt #docker, #windows und #mac Versionen.
die Desktop-Versionen können sich über #tailscale direkt mit eurem Smartphone verbinden.#ollama kompatibel, kann aber auch #anthropic, #openai und #deepseek.
-
Open source must win.
-
📊 Meet Kula: Monitorul de servere pentru Linux cu zero dependențe, un singur executabil și asistent AI integrat!
Kula este un instrument modern de monitorizare de sistem conceput pentru Linux, dezvoltat cu obiectivul de a fi cât mai simplu de instalat și utilizat. Livrat ca un single binary (un singur fișier executabil), Kula funcționează direct out of the box, fără baze de date externe, runtime-uri greoaie sau servicii terțe.
✨ Ce face Kula diferit și extrem de util?
⚙️ Fără dependențe & Colecție directă din kernel:
• Citește datele de sistem direct din directoarele virtuale /proc și /sys.
• Nu necesită instalarea de baze de date precum Prometheus sau InfluxDB pentru a stoca datele inițiale.🧠 Engine de stocare propriu (Custom Ring-Buffer):
• Folosește o arhitectură de stocare pe 3 niveluri (tiered storage), compresând și reducând rata de eșantionare pe măsură ce datele se învechesc (1 secundă raw, medii la 1 minut și medii la 5 minute), prevenind umplerea discului.💻 Interfață dublă: Web Dashboard & Terminal TUI:
• Include o interfață web Single Page Application (SPA) integrată direct în binar, conectată prin WebSocket pentru metrici live și grafice interactive.
• Oferă și un ecran TUI (Text User Interface) direct în terminal pentru inspecții rapide pe servere fărâ interfață grafică.🤖 Asistent AI integrat (prin Ollama):
• Dacă ai un serviciu local Ollama activ, Kula adaugă o funcționalitate unică: poți cere asistentului AI să îți analizeze graficele de performanță, consumul de resurse sau erorile directe din metrici, totul rulând 100% local.📈 Metrice colectate:
• Utilizare CPU per nucleu, memorie RAM/Swap, I/O pe disc, trafic de rețea, temperaturi senzori, alerte de supraincărcare și sincronizare ceas. Expostă și un endpoint pentru Prometheus dacă se dorește integrarea într-un stack existent.Un instrument excelent pentru administratorii de sistem și pasionații de self-hosting care doresc un monitorizor rapid, autonom și curat pe serverele lor Linux! 🚀
#Kula #Linux #ServerMonitoring #SelfHosted #SysAdmin #Ollama #AI #OpenSource #TechNews #TechMadeSimple
-
📊 Meet Kula: Monitorul de servere pentru Linux cu zero dependențe, un singur executabil și asistent AI integrat!
Kula este un instrument modern de monitorizare de sistem conceput pentru Linux, dezvoltat cu obiectivul de a fi cât mai simplu de instalat și utilizat. Livrat ca un single binary (un singur fișier executabil), Kula funcționează direct out of the box, fără baze de date externe, runtime-uri greoaie sau servicii terțe.
✨ Ce face Kula diferit și extrem de util?
⚙️ Fără dependențe & Colecție directă din kernel:
• Citește datele de sistem direct din directoarele virtuale /proc și /sys.
• Nu necesită instalarea de baze de date precum Prometheus sau InfluxDB pentru a stoca datele inițiale.🧠 Engine de stocare propriu (Custom Ring-Buffer):
• Folosește o arhitectură de stocare pe 3 niveluri (tiered storage), compresând și reducând rata de eșantionare pe măsură ce datele se învechesc (1 secundă raw, medii la 1 minut și medii la 5 minute), prevenind umplerea discului.💻 Interfață dublă: Web Dashboard & Terminal TUI:
• Include o interfață web Single Page Application (SPA) integrată direct în binar, conectată prin WebSocket pentru metrici live și grafice interactive.
• Oferă și un ecran TUI (Text User Interface) direct în terminal pentru inspecții rapide pe servere fărâ interfață grafică.🤖 Asistent AI integrat (prin Ollama):
• Dacă ai un serviciu local Ollama activ, Kula adaugă o funcționalitate unică: poți cere asistentului AI să îți analizeze graficele de performanță, consumul de resurse sau erorile directe din metrici, totul rulând 100% local.📈 Metrice colectate:
• Utilizare CPU per nucleu, memorie RAM/Swap, I/O pe disc, trafic de rețea, temperaturi senzori, alerte de supraincărcare și sincronizare ceas. Expostă și un endpoint pentru Prometheus dacă se dorește integrarea într-un stack existent.Un instrument excelent pentru administratorii de sistem și pasionații de self-hosting care doresc un monitorizor rapid, autonom și curat pe serverele lor Linux! 🚀
#Kula #Linux #ServerMonitoring #SelfHosted #SysAdmin #Ollama #AI #OpenSource #TechNews #TechMadeSimple
-
Local AI in 7 seconds
The local AI stack at speedrun pace: Ollama, Open WebUI, LibreChat, Stable Diffusion. Seven seconds, zero dollars, fully offline. Loops clean.
#Ollama #Openwebui #Privacyfirst #Encryption #Unraid #Itpro #Techsetup #Kubernetes #Minipc #Selfhosting
-
Local AI in 7 seconds
The local AI stack at speedrun pace: Ollama, Open WebUI, LibreChat, Stable Diffusion. Seven seconds, zero dollars, fully offline. Loops clean.
#Ollama #Openwebui #Privacyfirst #Encryption #Unraid #Itpro #Techsetup #Kubernetes #Minipc #Selfhosting
-
Hab mir im Februar ein #MacStudio mit #M4max und 128GB RAM gekauft... Für verrückte fast 4100€... Und ich dachte mir das ist der größte finanzielle Fehler ever
Hab damit dann viel #ollama #lmstudio #omlx gehostet - #LLM Experimentarium
Habs sogar ein paar Monaten nur mit den eigenen LLMs gecodet, aber Qualität naja...
Da sich die letzten Monate das #openWeights Business geändert hat und keine 120b Modelle veröffentlicht werden, die der perfekte fit dafür wären, nutze ich die 30b Modelle...
Leider mit zunehmendem Frust... #Gemma und #Qwen sind dafür einfach zu klein...
Dann bringt qwen auch nach 3.6 keine kleinen Modelle mehr raus - es gab kein 3.7 und kein 3.8 - letztes haben sie wieder man angekündigt
Bedeutet der Mac Studio war eigentlich nur als Desktop PC im Einsatz - eher #gaming und #Roblox programmierworkstation
Dann hab ich mich mal schlau gemacht - #apple hat meine 128gb Version zum frontier Modell gemacht - und die Modelle sind nirgendwo zu bekommen... Ganz merkwürdig Markt leer gesaugt
Vllt bringt Apple bald neue Mac Studio Modell raus???Okay - eBay preise abgecheckt - da gehen Modell für über 5k€ über den Tisch, aber sehr selten die 128gb Variante
eBay inseriert - 6999,99€ sofort kauf oder Preisvorschlag ab 6000€
Hab das Ding jetzt für 6200€ weiter verkauft
Leider über eBay bezahlt, deshalb wird mein Gewinn versteuert, aber ich gönne
Ist das nicht krass? Was da abgeht, das ist so verrückt auf dem Gebrauch Mac Markt!
-
Libre WebUI 0.21 is out. Self-hosted AI workspace: local models through Ollama, RAG with a sources panel, web search through your own SearXNG, and a sandbox for model-driven work you can verify with docker inspect. Apache 2.0, no telemetry, no CLA.
Demo, no signup: https://demo.librewebui.org
-
Local AI in 3 commands
curl, pull, run — a full local LLM in three typed commands. Instant answers, fully offline, zero subscription, and your prompts train nobody.
https://selfhost.directory/project/ollama
#Ollama #Weekendproject #Surveillance #Sysadmin #Technology #Homeserver #Datahoarder #Cybersecurity #Itpro
-
Local AI in 3 commands
curl, pull, run — a full local LLM in three typed commands. Instant answers, fully offline, zero subscription, and your prompts train nobody.
https://selfhost.directory/project/ollama
#Ollama #Weekendproject #Surveillance #Sysadmin #Technology #Homeserver #Datahoarder #Cybersecurity #Itpro
-
For: Linux distro developers
Subject: Building Vulkan ollama from sourceI've been working on my own Linux distro [Laclin] for 30 years.
This week, I managed to get a #Vulkan copy of #ollama to build in my distro. This post is a high-level overview of the process for other distro developers. Note: "Vulkan" means that it only works for some chipsets but it works out of the box in those cases.
Advisory: Builds from source are straight-forward in standard distros. If you're creating a non-standard distro from source, the process isn't for the faint-hearted. New packages can mean the need to juggle a dozen pieces.
"ollama" dependencies include the following packages. If your distro breaks packages into production and devel versions, the devel versions are needed.
bzip2, cmake, elfutils, eudev, expat, gcc [or clang], git, go, make, ncurses, pkgconf, python3, xorg, xzutils, zlib, zstd
To build "ollama" from source, you need to collect sources for the following pieces and get each of them to build separately.
xorg - You need to build "libvulkan_*.so" libraries [note the underscore] and install Vulkan ICD "*.json" files. These steps are part of the build of the "xorg" Mesa component, so you might find that they've already been done.
glslang - This needs to be installed as a separate package and also as a source tree that goes into the "shaderc" source tree. The build per se is simple "cmake".
git repo: https://github.com/KhronosGroup/glslang.git
spirv-headers - This needs to be installed as a separate package and also as a source tree that goes into the "spirv-tools" source tree. The build per se is simple "cmake".
git repo: https://github.com/KhronosGroup/SPIRV-Headers.git
spirv-tools - You need to add a copy of the "spirv-headers" source tree to this source tree. The build per se is simple "cmake".
git repo: https://github.com/KhronosGroup/SPIRV-Tools.git
shaderc - You need to add copies of the "glslang" and "spirv-tools" source trees to this source tree. The build per se is simple "cmake".
For this package, I recommend that you add the following "cmake" option setting:
-DSHADERC_SKIP_TESTS=ONgit repo: https://github.com/google/shaderc.git
vulkan-headers - The build for this package is simple "cmake".
git repo: https://github.com/KhronosGroup/Vulkan-Headers.git
vulkan-loader - This package provides a high-level Vulkan library named "libvulkan.so". That file is separate from the "libvulkan_*.so" files mentioned above. The build is simple "cmake".
git repo: https://github.com/KhronosGroup/Vulkan-Loader.git
vulkan-sdk - I didn't use upstream sources directly for this package. In my version:
There is a "bin" directory. It contains symlinks to the "glslang" and "glslangValidator" executables in the "glslang" package.
There are "include" and "share" directories. These are simply the corresponding "vulkan-headers" directories. "vulkan-headers" is installed to the "vulkan-sdk" prefix.
There is a "lib" directory. It is simply the "vulkan-loader" lib directory. "vulkan-loader" is installed to the "vulkan-sdk" prefix. Symlinks to the "xorg" "libvulkan_*.so" library files are added to the "lib" directory.
ollama - This is the tricky package in the list.
git repo: https://github.com/ollama/ollama.git
The build procedure for "ollama" looks roughly like this:
# Path to desired "ollama" prefix directory PP=/somewhere/ollama rm -fr $PP BINDIR=$PP/bin DATADIR=$PP/data LIBDIR=$PP/lib mkdir -p $BINDIR $DATADIR $LIBDIR # Path to "spirv-headers" prefix directory export CMAKE_PREFIX_PATH=/somewhere/spirv-headers # Path to "vulkan-sdk" prefix directory export VULKAN_SDK=/somewhere/vulkan-sdk # Path to "xorg" prefix directory [export isn't needed] XORG_PREFIX=/somewhere/xorg rm -fr ollama git clone --depth 1 https://github.com/ollama/ollama.git cd ollama go generate ./... pushd llama/server/ cmake -DGGML_VULKAN=ON -DCMAKE_BUILD_TYPE=Release . make -j$(nproc) popd go build mv ollama $BINDIR/ mv llama/server/bin/*.so* $LIBDIR/ mv llama/server/bin/* $BINDIR/ cp -p $XORG_PREFIX/share/vulkan/icd.d/*.json $DATADIR/Installation of LLM models and how to run the "ollama" server and client is/are beyond the scope of these notes.
Here's one tip related to that: At runtime, you'll need to add the BINDIR and LIBDIR settings indicated above to PATH and LD_LIBRARY_PATH [respectively]. In "bash", the latter two environment variables should also exported using "export".
-
For: Linux distro developers
Subject: Building Vulkan ollama from sourceI've been working on my own Linux distro [Laclin] for 30 years.
This week, I managed to get a #Vulkan copy of #ollama to build in my distro. This post is a high-level overview of the process for other distro developers. Note: "Vulkan" means that it only works for some chipsets but it works out of the box in those cases.
Advisory: Builds from source are straight-forward in standard distros. If you're creating a non-standard distro from source, the process isn't for the faint-hearted. New packages can mean the need to juggle a dozen pieces.
"ollama" dependencies include the following packages. If your distro breaks packages into production and devel versions, the devel versions are needed.
bzip2, cmake, elfutils, eudev, expat, gcc [or clang], git, go, make, ncurses, pkgconf, python3, xorg, xzutils, zlib, zstd
To build "ollama" from source, you need to collect sources for the following pieces and get each of them to build separately.
xorg - You need to build "libvulkan_*.so" libraries [note the underscore] and install Vulkan ICD "*.json" files. These steps are part of the build of the "xorg" Mesa component, so you might find that they've already been done.
glslang - This needs to be installed as a separate package and also as a source tree that goes into the "shaderc" source tree. The build per se is simple "cmake".
git repo: https://github.com/KhronosGroup/glslang.git
spirv-headers - This needs to be installed as a separate package and also as a source tree that goes into the "spirv-tools" source tree. The build per se is simple "cmake".
git repo: https://github.com/KhronosGroup/SPIRV-Headers.git
spirv-tools - You need to add a copy of the "spirv-headers" source tree to this source tree. The build per se is simple "cmake".
git repo: https://github.com/KhronosGroup/SPIRV-Tools.git
shaderc - You need to add copies of the "glslang" and "spirv-tools" source trees to this source tree. The build per se is simple "cmake".
For this package, I recommend that you add the following "cmake" option setting:
-DSHADERC_SKIP_TESTS=ONgit repo: https://github.com/google/shaderc.git
vulkan-headers - The build for this package is simple "cmake".
git repo: https://github.com/KhronosGroup/Vulkan-Headers.git
vulkan-loader - This package provides a high-level Vulkan library named "libvulkan.so". That file is separate from the "libvulkan_*.so" files mentioned above. The build is simple "cmake".
git repo: https://github.com/KhronosGroup/Vulkan-Loader.git
vulkan-sdk - I didn't use upstream sources directly for this package. In my version:
There is a "bin" directory. It contains symlinks to the "glslang" and "glslangValidator" executables in the "glslang" package.
There are "include" and "share" directories. These are simply the corresponding "vulkan-headers" directories. "vulkan-headers" is installed to the "vulkan-sdk" prefix.
There is a "lib" directory. It is simply the "vulkan-loader" lib directory. "vulkan-loader" is installed to the "vulkan-sdk" prefix. Symlinks to the "xorg" "libvulkan_*.so" library files are added to the "lib" directory.
ollama - This is the tricky package in the list.
git repo: https://github.com/ollama/ollama.git
The build procedure for "ollama" looks roughly like this:
# Path to desired "ollama" prefix directory PP=/somewhere/ollama rm -fr $PP BINDIR=$PP/bin DATADIR=$PP/data LIBDIR=$PP/lib mkdir -p $BINDIR $DATADIR $LIBDIR # Path to "spirv-headers" prefix directory export CMAKE_PREFIX_PATH=/somewhere/spirv-headers # Path to "vulkan-sdk" prefix directory export VULKAN_SDK=/somewhere/vulkan-sdk # Path to "xorg" prefix directory [export isn't needed] XORG_PREFIX=/somewhere/xorg rm -fr ollama git clone --depth 1 https://github.com/ollama/ollama.git cd ollama go generate ./... pushd llama/server/ cmake -DGGML_VULKAN=ON -DCMAKE_BUILD_TYPE=Release . make -j$(nproc) popd go build mv ollama $BINDIR/ mv llama/server/bin/*.so* $LIBDIR/ mv llama/server/bin/* $BINDIR/ cp -p $XORG_PREFIX/share/vulkan/icd.d/*.json $DATADIR/Installation of LLM models and how to run the "ollama" server and client is/are beyond the scope of these notes.
Here's one tip related to that: At runtime, you'll need to add the BINDIR and LIBDIR settings indicated above to PATH and LD_LIBRARY_PATH [respectively]. In "bash", the latter two environment variables should also exported using "export".
-
Subject: Diversity and historical truth
Image: Hitler SS troops carrying watermelons. This was created using GenAI. The context is explained below. [Hold criticism of the use of GenAI as the point is related to GenAI itself.]
I've added #ollama to my Linux distro. My distro now supports offline LLMs out of the box for laptops with some chipsets. No setup steps are needed. It just works.
However, I'm not impressed with the offline LLMs that I've tried so far.
I showed Bonsai Kitten of Gentoo some output from Mistral Instruct tonight. [Mistral Instruct is an LLM that I tested in "ollama".] He offered a few comments that made me chuckle. So, here's part of the discussion.
The term "SS" is a World War II term. "SS" refers to Adolf Hitler's Schutzstaffel troops. The Schutzstaffel were the #ICE of the 1930s to 1940s.
<xiaomiao> it has good grammar and is using words that seem to be "reasonable"
<OldCoder> It's trite. It would never fool anybody.
<xiaomiao> so it is roughly on the level of the average middle manager ;)
<OldCoder> If you used this in business, that would be bad.
<xiaomiao> you overestimate people - I've seen a lot of them outsource all thinking to LLMs
<xiaomiao> almost as if thinking hurt
<xiaomiao> there's a lot of weird AI slop [on YouTube] now
<xiaomiao> text-to-speech has become good enough
<xiaomiao> but you can easily recognize it - no californian pronounces danish words correctly
<xiaomiao> still, that voice ... sigh ... I would prefer to never hear it again
* OldCoder favorite is the World War II video that looked realistic...
<OldCoder> [AI] Footage of a Japanese warship
<OldCoder> On the deck, there was a U.S. commander directing the attack on Pearl Harbor.
<OldCoder> The editors didn't catch it.
<xiaomiao> ah yes
<xiaomiao> early days of AI image generation ... everyone had The Smile
<xiaomiao> y'know, only USians do this weird "show as much teeth as possible" creepy smile
<xiaomiao> and then google added filtering so you couldn't get only white people. enforced diversity!
<xiaomiao> SS troops now have mexicans and black people, to balance things
<OldCoder> For real?
<xiaomiao> people figured out a workaround: [they added] "with watermelons"
<xiaomiao> which removed all black people because we're not racist! Nein, ve are NOTT.
<OldCoder> The videos have watermelons?
<xiaomiao> yes!
<OldCoder> The SS carries them?
<OldCoder> Isn't that historically inaccurate?
<xiaomiao> yeah why not
<xiaomiao> diversity is strength! every space requires diversity ;)
<xiaomiao> from that follows that adding "minorities" is the correct thing to do
<OldCoder> I'm thinking about take-aways.
<OldCoder> AI might make Orwell's vision more likely.
<OldCoder> People know that AI videos are fake...
<OldCoder> But perhaps they'll be treated as "the truth" [in a sense] "now that we know it".
<OldCoder> No reality.
I asked an LLM about this. The LLM responded:
"Yes, it's true that [Google's Gemini] implemented aggressive diversity-enforcing constraints that frequently injected Black, Indigenous, or other people of color into contexts where they were historically inaccurate."
"[It's also true] that user experimentation revealed certain prompt changes or offensive tropes, such as adding stereotypical modifiers, could alter or subvert these hardcoded demographic filters."
#AI #GenAI #LLM #diversity #history #race -
Subject: Diversity and historical truth
Image: Hitler SS troops carrying watermelons. This was created using GenAI. The context is explained below. [Hold criticism of the use of GenAI as the point is related to GenAI itself.]
I've added #ollama to my Linux distro. My distro now supports offline LLMs out of the box for laptops with some chipsets. No setup steps are needed. It just works.
However, I'm not impressed with the offline LLMs that I've tried so far.
I showed Bonsai Kitten of Gentoo some output from Mistral Instruct tonight. [Mistral Instruct is an LLM that I tested in "ollama".] He offered a few comments that made me chuckle. So, here's part of the discussion.
The term "SS" is a World War II term. "SS" refers to Adolf Hitler's Schutzstaffel troops. The Schutzstaffel were the #ICE of the 1930s to 1940s.
<xiaomiao> it has good grammar and is using words that seem to be "reasonable"
<OldCoder> It's trite. It would never fool anybody.
<xiaomiao> so it is roughly on the level of the average middle manager ;)
<OldCoder> If you used this in business, that would be bad.
<xiaomiao> you overestimate people - I've seen a lot of them outsource all thinking to LLMs
<xiaomiao> almost as if thinking hurt
<xiaomiao> there's a lot of weird AI slop [on YouTube] now
<xiaomiao> text-to-speech has become good enough
<xiaomiao> but you can easily recognize it - no californian pronounces danish words correctly
<xiaomiao> still, that voice ... sigh ... I would prefer to never hear it again
* OldCoder favorite is the World War II video that looked realistic...
<OldCoder> [AI] Footage of a Japanese warship
<OldCoder> On the deck, there was a U.S. commander directing the attack on Pearl Harbor.
<OldCoder> The editors didn't catch it.
<xiaomiao> ah yes
<xiaomiao> early days of AI image generation ... everyone had The Smile
<xiaomiao> y'know, only USians do this weird "show as much teeth as possible" creepy smile
<xiaomiao> and then google added filtering so you couldn't get only white people. enforced diversity!
<xiaomiao> SS troops now have mexicans and black people, to balance things
<OldCoder> For real?
<xiaomiao> people figured out a workaround: [they added] "with watermelons"
<xiaomiao> which removed all black people because we're not racist! Nein, ve are NOTT.
<OldCoder> The videos have watermelons?
<xiaomiao> yes!
<OldCoder> The SS carries them?
<OldCoder> Isn't that historically inaccurate?
<xiaomiao> yeah why not
<xiaomiao> diversity is strength! every space requires diversity ;)
<xiaomiao> from that follows that adding "minorities" is the correct thing to do
<OldCoder> I'm thinking about take-aways.
<OldCoder> AI might make Orwell's vision more likely.
<OldCoder> People know that AI videos are fake...
<OldCoder> But perhaps they'll be treated as "the truth" [in a sense] "now that we know it".
<OldCoder> No reality.
I asked an LLM about this. The LLM responded:
"Yes, it's true that [Google's Gemini] implemented aggressive diversity-enforcing constraints that frequently injected Black, Indigenous, or other people of color into contexts where they were historically inaccurate."
"[It's also true] that user experimentation revealed certain prompt changes or offensive tropes, such as adding stereotypical modifiers, could alter or subvert these hardcoded demographic filters."
#AI #GenAI #LLM #diversity #history #race -
Your own ChatGPT. No subscription.
The local AI stack: Ollama runs the models, Open WebUI is the interface, LibreChat unifies every AI, AnythingLLM chats with your documents, Stable Diffusion makes the images. All free, all offline, nothing you type leaves your house.
#Ollama #Openwebui #Encryption #Privacyfirst #Sysadmin #Opensource #Privacy #Linux #Homelab #Unraid
-
Your own ChatGPT. No subscription.
The local AI stack: Ollama runs the models, Open WebUI is the interface, LibreChat unifies every AI, AnythingLLM chats with your documents, Stable Diffusion makes the images. All free, all offline, nothing you type leaves your house.
#Ollama #Openwebui #Encryption #Privacyfirst #Sysadmin #Opensource #Privacy #Linux #Homelab #Unraid
-
Do we really hate #LLMs this much? That we would go through a public flogging and the self-flagellation of one Hank Green? For using #AI for looking up some papers? I will never pay for a commercial LLM, anymore than I will use a commercial social media (other than YouTube, you got me... tell me who is perfect I'm a little google using biatch.) Because there is honestly no reason because #Ollama
My point is, we are having public morality plays about this tiny piffle?
-
Do we really hate #LLMs this much? That we would go through a public flogging and the self-flagellation of one Hank Green? For using #AI for looking up some papers? I will never pay for a commercial LLM, anymore than I will use a commercial social media (other than YouTube, you got me... tell me who is perfect I'm a little google using biatch.) Because there is honestly no reason because #Ollama
My point is, we are having public morality plays about this tiny piffle?
-
SoloMD 4.0 porta l'intelligenza artificiale direttamente nell'editor Markdown con agenti locali, automazione controllata e integrazione MCP. Scopri tutte le novità. #Linux #OpenSource #Markdown #AI #Ollama #Productivity https://www.linuxeasy.org/solomd-4-0-porta-gli-agenti-ai-direttamente-nelleditor-markdown/
-
SoloMD 4.0 porta l'intelligenza artificiale direttamente nell'editor Markdown con agenti locali, automazione controllata e integrazione MCP. Scopri tutte le novità. #Linux #OpenSource #Markdown #AI #Ollama #Productivity https://www.linuxeasy.org/solomd-4-0-porta-gli-agenti-ai-direttamente-nelleditor-markdown/
-
Как я Zabbix с LLM дружил в свободное время. Архитектурный обзор взаимодействия с нейросетью. Часть 4 «Реализация»
Это заключительная статья цикла о том, как я пытался сделать алерты Zabbix в домашней лаборатории чуть умнее, прикрутив к ним локальную LLM и не получить на выходе архитектурного монстра Франкенштейна. В первой и второй частях мы разобрались с постановкой задачи и выбрали себе фаворита из локальных LLM, в третьей — занимались скучным проектированием HLD и LLD. Теперь же переходим к самому интересному — прикладному материалу. В этой статье рассмотрим, что получилось, когда архитектурный каркас начали последовательно превращать в рабочий self-hosted сервис в коде, и с какими узкими местами пришлось столкнуться в процессе. DISCLAIMER: к сожалению, выпуск задержался, ведь основное место работы отнимает огромное количество времени, только отпуск позволяет вернуться к личным проектам. Часть 1: Вводная и формирование ТЗ Часть 2: Выбор локальной LLM Часть 3: Формирование HLD и немного LLD Часть 4: Что из этого вышло (Вы здесь)
https://habr.com/ru/articles/1067622/
#zabbix #llm #aiops #мониторинг #алерты #автоматизация #ollama #python #rca #промптинжиниринг
-
Data gravity is the force pulling AI workflows toward one provider. The four-stage lock-in mechanism, a scoring checklist, and how to stay portable.
#LLM #AI #Self-Hosting #SelfHosting #Ollama #Privacy #Open Source #Security #Cloud #Hosting #Hardware #Architecture
https://www.glukhov.org/llm-hosting/self-hosting/data-gravity-ai-vendor-lockin/
-
Data gravity is the force pulling AI workflows toward one provider. The four-stage lock-in mechanism, a scoring checklist, and how to stay portable.
#LLM #AI #Self-Hosting #SelfHosting #Ollama #Privacy #Open Source #Security #Cloud #Hosting #Hardware #Architecture
https://www.glukhov.org/llm-hosting/self-hosting/data-gravity-ai-vendor-lockin/
-
🧵 Η ιστορία του AI στο @ONLYOFFICE – από ένα απλό plugin σε πλήρες οικοσύστημα
Το 2023 ξεκινήσαμε με ένα plugin για ChatGPT. Σήμερα:
🔹 7+ AI providers (OpenAI, Anthropic, Mistral, DeepSeek, Ollama, xAI, Google AI)
🔹 Ενσωματωμένος AI agent σε editors & DocSpace
🔹 Πλήρως opt-in, provider-agnostic, local deployment με OllamaΔιαβάστε το άρθρο εδώ 👇
https://www.onlyoffice.com/blog/el/2026/08/onlyoffice-made-friends-with-ai#ONLYOFFICE #AI #OpenSource #SelfHosted #FOSS #DocSpace #Productivity #Tech #Ollama #DataPrivacy
-
🧵 Η ιστορία του AI στο @ONLYOFFICE – από ένα απλό plugin σε πλήρες οικοσύστημα
Το 2023 ξεκινήσαμε με ένα plugin για ChatGPT. Σήμερα:
🔹 7+ AI providers (OpenAI, Anthropic, Mistral, DeepSeek, Ollama, xAI, Google AI)
🔹 Ενσωματωμένος AI agent σε editors & DocSpace
🔹 Πλήρως opt-in, provider-agnostic, local deployment με OllamaΔιαβάστε το άρθρο εδώ 👇
https://www.onlyoffice.com/blog/el/2026/08/onlyoffice-made-friends-with-ai#ONLYOFFICE #AI #OpenSource #SelfHosted #FOSS #DocSpace #Productivity #Tech #Ollama #DataPrivacy
-
Recording available: #OpenRefine LLM Extension Demo.
Includes data journalism workflows, name cleaning with LLMs, library metadata use cases, #Ollama model testing, structured JSON output, and Q&A session
Watch: https://youtu.be/UnAv9DDVAVI
Details: https://forum.openrefine.org/t/community-call-openrefine-llm-extension-demo/2923