#llamafile — Public Fediverse posts

What if the soon to be released @silex Desktop shipped a way to fine-tune your own small, open AI locally?

A ~1B open model could be fine-tuned right inside Silex to learn how the user uses Silex and imitate via MCP. Runs on modest hardware, your data never leaves your machine

The stack: #Luciole, the model by #OpenLLMFrance / @LINAGORA, #llamafile by @mozilla

I'd be happy to find Silex users who want to co-build this, I have no idea how to make it happen 😅

In? 👇

#foss #LocalAI #llamafile

What if the soon to be released @silex Desktop shipped a way to fine-tune your own small, open AI locally?

A ~1B open model could be fine-tuned right inside Silex to learn how the user uses Silex and imitate via MCP. Runs on modest hardware, your data never leaves your machine

The stack: #Luciole, the model by #OpenLLMFrance / @LINAGORA, #llamafile by @mozilla

I'd be happy to find Silex users who want to co-build this, I have no idea how to make it happen 😅

In? 👇

#foss #LocalAI #llamafile

I bet that in 2030 we'll be using claude or gpt only to setup local models with llamafile, optimized for specific tasks on a specific laptop or phone

> The only thing Internet Explorer is good for is downloading Firefox

@mozilla #llamafile is a #foss alternative to VC funded #ollama

#ai #llm #slm #fantasticfour #enshitification #OpenSource

I bet that in 2030 we'll be using claude or gpt only to setup local models with llamafile, optimized for specific tasks on a specific laptop or phone

> The only thing Internet Explorer is good for is downloading Firefox

@mozilla #llamafile is a #foss alternative to VC funded #ollama

#ai #llm #slm #fantasticfour #enshitification #OpenSource

Neste vídeo, mostro como criar uma IA local portátil no Linux utilizando o Llamafile e um modelo no formato GGUF, armazenados em um pendrive ou SSD externo.

Link: https://youtu.be/UELV_vluOPQ

#llamafile #ibmgranite #ialocal #tech #ferramentaia #iagratis #InovacaoTech #IAPortatil #linuxmint #linux

Neste vídeo, mostro como criar uma IA local portátil no Linux utilizando o Llamafile e um modelo no formato GGUF, armazenados em um pendrive ou SSD externo.

Link: https://youtu.be/UELV_vluOPQ

#llamafile #ibmgranite #ialocal #tech #ferramentaia #iagratis #InovacaoTech #IAPortatil #linuxmint #linux

Hmmm... 🤨

#Llamafile: Run #AI Models Locally on Your PC with Just One File https://firethering.com/llamafile-run-ai-models-locally-one-file/ #LLM #GenAI

Hmmm... 🤨

#Llamafile: Run #AI Models Locally on Your PC with Just One File https://firethering.com/llamafile-run-ai-models-locally-one-file/ #LLM #GenAI

Encántame este vídeo de Mancomún sobre Llamafile! Aprende a executar modelos de IA de xeito sinxelo no teu propio ordenador, con explicacións claras e ligazón ao artigo. Perfecto para quen quere probar IA local e software libre. Anímate a experimentar! #Llamafile #IA #InteligenciaArtificial #SoftwareLibre #Mancomun #Galego #PeerTube
https://v.eurorede.com/videos/watch/22adee43-95aa-4eb5-aa8d-4691a2fa6193

Encántame este vídeo de Mancomún sobre Llamafile! Aprende a executar modelos de IA de xeito sinxelo no teu propio ordenador, con explicacións claras e ligazón ao artigo. Perfecto para quen quere probar IA local e software libre. Anímate a experimentar! #Llamafile #IA #InteligenciaArtificial #SoftwareLibre #Mancomun #Galego #PeerTube
https://v.eurorede.com/videos/watch/22adee43-95aa-4eb5-aa8d-4691a2fa6193

#Mozilla Releases #Llamafile 0.10 To Enhance Their #AI Offering For Easy-To-Use LLMs
Llamafile is a https://Mozilla.ai project to distribute and run large language models as a single file. With a single Llamafile you can run the #LLM across platforms and with varying hardware support. Their intentions are on making LLMs more accessible and convenient to both developers and end-users.
https://www.phoronix.com/news/Mozilla-AI-Llamafile-0.10

#Mozilla Releases #Llamafile 0.10 To Enhance Their #AI Offering For Easy-To-Use LLMs
Llamafile is a https://Mozilla.ai project to distribute and run large language models as a single file. With a single Llamafile you can run the #LLM across platforms and with varying hardware support. Their intentions are on making LLMs more accessible and convenient to both developers and end-users.
https://www.phoronix.com/news/Mozilla-AI-Llamafile-0.10

Mozilla Releases Llamafile 0.10 To Enhance Their AI Offering For Easy-To-Use LLMs - Phoronix

｢ Llamafile is a https://Mozilla.ai project to distribute and run large language models as a single file. With a single Llamafile you can run the LLM across platforms and with varying hardware support. Their intentions are on making LLMs more accessible and convenient to both developers and end-users ｣

https://www.phoronix.com/news/Mozilla-AI-Llamafile-0.10

#ai #llamafile #llm #mozilla

Mozilla Releases Llamafile 0.10 To Enhance Their AI Offering For Easy-To-Use LLMs - Phoronix

｢ Llamafile is a https://Mozilla.ai project to distribute and run large language models as a single file. With a single Llamafile you can run the LLM across platforms and with varying hardware support. Their intentions are on making LLMs more accessible and convenient to both developers and end-users ｣

https://www.phoronix.com/news/Mozilla-AI-Llamafile-0.10

#ai #llamafile #llm #mozilla

Mozilla rilancia Llamafile con la versione 0.10: supporto immagini, GPU Metal e CUDA, Whisper e Stable Diffusion integrati. Un passo avanti per rendere i modelli linguistici più accessibili. #Mozilla #Llamafile #Linux #OpenSource

https://www.linuxeasy.org/mozilla-rilascia-llamafile-0-10/?utm_source=mastodon&utm_medium=jetpack_social

Mozilla rilancia Llamafile con la versione 0.10: supporto immagini, GPU Metal e CUDA, Whisper e Stable Diffusion integrati. Un passo avanti per rendere i modelli linguistici più accessibili. #Mozilla #Llamafile #Linux #OpenSource

https://www.linuxeasy.org/mozilla-rilascia-llamafile-0-10/?utm_source=mastodon&utm_medium=jetpack_social

llamafile: Distribute and Run LLMs with a Single File

https://github.com/mozilla-ai/llamafile

#HackerNews #llamafile #LLMs #MozillaAI #AItools #MachineLearning #DistributeRun

llamafile: Distribute and Run LLMs with a Single File

https://github.com/mozilla-ai/llamafile

#HackerNews #llamafile #LLMs #MozillaAI #AItools #MachineLearning #DistributeRun

🦙 llamafile returns!

Mozilla.ai is adopting llamafile to push forward open, local, privacy-first AI.

We’re refreshing the codebase and rebuilding the roadmap with feedback from the community.

Share your ideas on GitHub, Discord, or Hacker News—and help shape the next phase of llamafile.

🔗 https://blog.mozilla.ai/llamafile-returns/

#MozillaAI #llamafile #opensource #LocalAI #AIcommunity

🦙 llamafile returns!

Mozilla.ai is adopting llamafile to push forward open, local, privacy-first AI.

We’re refreshing the codebase and rebuilding the roadmap with feedback from the community.

Share your ideas on GitHub, Discord, or Hacker News—and help shape the next phase of llamafile.

🔗 https://blog.mozilla.ai/llamafile-returns/

#MozillaAI #llamafile #opensource #LocalAI #AIcommunity

At DjangoCon US 2025 in Chicago, more than one person shared the workflow of dictating their articles or slide notes to a template using mobile apps 🎙️

I was experimenting with https://huggingface.co/Mozilla/whisperfile, and it seems to work well on my PC 🔴

It occurred to me that it could be used to add live captioning to meetups or small conferences that can't afford live captioners as good as the one we had at DjangoCon 💡

Have any of you done any experiments?

#Captioning #Conference #Whisper #llamafile

At DjangoCon US 2025 in Chicago, more than one person shared the workflow of dictating their articles or slide notes to a template using mobile apps 🎙️

I was experimenting with https://huggingface.co/Mozilla/whisperfile, and it seems to work well on my PC 🔴

It occurred to me that it could be used to add live captioning to meetups or small conferences that can't afford live captioners as good as the one we had at DjangoCon 💡

Have any of you done any experiments?

#Captioning #Conference #Whisper #llamafile

@naturzukunft

There aren't that many choices to manage exploding information complexity so something must happen.

Even if it is not the semantic web as we knew it, it must solve similar problems (and hence look similar - as form follows function).

Removing frictions is key imho. See e.g. how using complex LLM models is now down to just one #llamafile

Semantic web tooling (at least the public / open source part) never reached a sweetspot for broad adoption, always somewhat aloof

@rzeta0

@naturzukunft

There aren't that many choices to manage exploding information complexity so something must happen.

Even if it is not the semantic web as we knew it, it must solve similar problems (and hence look similar - as form follows function).

Removing frictions is key imho. See e.g. how using complex LLM models is now down to just one #llamafile

Semantic web tooling (at least the public / open source part) never reached a sweetspot for broad adoption, always somewhat aloof

@rzeta0

In #BYOTA, we use #llamafile to calculate *sentence embeddings*.
If you don’t know what embeddings are, just think about them as numerical descriptors of your Mastodon statuses, which are closer (as in two cities’ coordinates being close on a map) the more semantically similar their respective statuses are. We’ll get back later to this with a more visual description. If you are interested in embeddings and wanna delve deeper, see https://vickiboykis.com/what_are_embeddings/ by @vicki.

In #BYOTA, we use #llamafile to calculate *sentence embeddings*.
If you don’t know what embeddings are, just think about them as numerical descriptors of your Mastodon statuses, which are closer (as in two cities’ coordinates being close on a map) the more semantically similar their respective statuses are. We’ll get back later to this with a more visual description. If you are interested in embeddings and wanna delve deeper, see https://vickiboykis.com/what_are_embeddings/ by @vicki.

#Llamafile is a Mozilla tool that packages a language model in a single executable file that will run on most platforms. It is 100% local and has been optimized to run on slower hardware, from Raspberry Pis to my 8yo laptop. It is based on llama.cpp which supports a plethora of models, not just LLMs: I chose all-minilm because it’s tiny (50MB) and has open code, research papers, and datasets. https://github.com/Mozilla-Ocho/llamafile https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2

#Llamafile is a Mozilla tool that packages a language model in a single executable file that will run on most platforms. It is 100% local and has been optimized to run on slower hardware, from Raspberry Pis to my 8yo laptop. It is based on llama.cpp which supports a plethora of models, not just LLMs: I chose all-minilm because it’s tiny (50MB) and has open code, research papers, and datasets. https://github.com/Mozilla-Ocho/llamafile https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2

Второе пришествие мейнфреймов. Всё больше компаний хотят запускать ИИ у себя в офисе

Мейнфрейм IBM z16 во время лабораторных тестов в 2022 г, источник Приложения ИИ находят применение в бизнесе. Но есть проблема: корпоративные данные и документация представляют коммерческую тайну. Их нельзя передавать на сторону, тем более в облачную систему машинного обучения. Кроме того, что сама передача небезопасна, так ещё и публичная модель будет обучаться на наших секретах , а потом помогать конкурентам. В общем, у коммерческих компаний остаётся один вариант: поднимать собственный сервер или вычислительный кластер с ИИ. Таким образом, из эпохи облачных вычислений мы возвращаемся к старому доброму самохостингу, только сейчас это самохостинг GPU , серверы и мейнфреймы.

https://habr.com/ru/companies/ruvds/articles/867316/

#IBM #мейнфреймы #Telum_II #AnythingLLM #ChatGPT #Meta #обман #человечество #Mount_Diablo #IBM_z16 #самохостинг #ЦОД #датацентр #WatsonX #Copilot #Twinny #llamafile #Ollama #GPT4All #FraudGPT #WormGPT #Khoj #LocalAI #ruvds_статьи

Llamafile by Mozilla

Hi #fedifriends

has any of you experience with #llamafile by #Mozilla?
I would like to use a local #LLM #AI to get some help to create #XLST styles to run against #XLS and #CSV files with the goal of create #XML files without being an #XSLT champion...

I would like to do it locally, not depending stricly on #Linux and #Nvidia, with some #ethical software and looks like Llamafile check marks all those voices.

Thanks... 🙏

#fedihelp #fediask

Llamafile by Mozilla

Hi #fedifriends

has any of you experience with #llamafile by #Mozilla?
I would like to use a local #LLM #AI to get some help to create #XLST styles to run against #XLS and #CSV files with the goal of create #XML files without being an #XSLT champion...

I would like to do it locally, not depending stricly on #Linux and #Nvidia, with some #ethical software and looks like Llamafile check marks all those voices.

Thanks... 🙏

#fedihelp #fediask

Llamafile by Mozilla

Hi #fedifriends

has any of you experience with #llamafile by #Mozilla?
I would like to use a local #LLM #AI to get some help to create #XLST styles to run against #XLS and #CSV files with the goal of create #XML files without being an #XSLT champion...

I would like to do it locally, not depending stricly on #Linux and #Nvidia, with some #ethical software and looks like Llamafile check marks all those voices.

Thanks... 🙏

#fedihelp #fediask

Llamafile by Mozilla

Hi #fedifriends

has any of you experience with #llamafile by #Mozilla?
I would like to use a local #LLM #AI to get some help to create #XLST styles to run against #XLS and #CSV files with the goal of create #XML files without being an #XSLT champion...

I would like to do it locally, not depending stricly on #Linux and #Nvidia, with some #ethical software and looks like Llamafile check marks all those voices.

Thanks... 🙏

#fedihelp #fediask

Experimenting with #marimo, mastodon API, and #llamafile for my "Build Your Own Timeline Algorithm" project. 100% local, except those 11 seconds it took me to download my home timeline.

I have been pitching this idea around for almost two years now, and while I felt bad for not pushing more for it, I am glad that in the meantime new cool tech became available allowing me to do something even better than I imagined.

Seriously, #llamafile is amazing. On-device #llm with almost zero effort. Spectacular.

https://github.com/Mozilla-Ocho/llamafile

Seriously, #llamafile is amazing. On-device #llm with almost zero effort. Spectacular.

https://github.com/Mozilla-Ocho/llamafile

I also added Q4_K_M quantizations. #llm #llamafile

I also added Q4_K_M quantizations. #llm #llamafile

I also put some Llama 3.2 llamafiles onto the Docker hub: https://hub.docker.com/?namespace=maragudk . Quite nice for CI. #llm #llamafile

I also put some Llama 3.2 llamafiles onto the Docker hub: https://hub.docker.com/?namespace=maragudk . Quite nice for CI. #llm #llamafile

And if you don't want to build one yourself and just want to try out the small new Llama 3.2 models yourself, have some links:

- https://assets.maragu.dev/llm/Llama-3.2-1B-Instruct-Q8_0.llamafile
- https://assets.maragu.dev/llm/Llama-3.2-3B-Instruct-Q8_0.llamafile

#llm #llamafile

And if you don't want to build one yourself and just want to try out the small new Llama 3.2 models yourself, have some links:

- https://assets.maragu.dev/llm/Llama-3.2-1B-Instruct-Q8_0.llamafile
- https://assets.maragu.dev/llm/Llama-3.2-3B-Instruct-Q8_0.llamafile

#llm #llamafile

If you're into #llm stuff, I've created a small repository with scripts to create a #llamafile from a GGUF model.

In plain English, it makes it easy to download a language model and turn it into a file you can run directly. Super fun, super easy. https://github.com/maragudk/llamafile

If you're into #llm stuff, I've created a small repository with scripts to create a #llamafile from a GGUF model.

In plain English, it makes it easy to download a language model and turn it into a file you can run directly. Super fun, super easy. https://github.com/maragudk/llamafile