#microflare — Public Fediverse posts

I've been working hard on a project for the past few weeks. I've made a custom version of Qwen 35B-A3B that is small enough to be run on just a 4GB GPU but still gives you high quality output.

People are abusing AI and it's overhyped sure, but the tech does have some value. And with a local AI you are in control, no one's logging your chats. No need for a massive data center. Everyone deserves access

https://microflare.bearblog.dev/introducing-microflare-v1/

#llm #ai #localAI #localLLM #openModels #qwen #microFlare #selfHosted

I've been working hard on a project for the past few weeks. I've made a custom version of Qwen 35B-A3B that is small enough to be run on just a 4GB GPU but still gives you high quality output.

People are abusing AI and it's overhyped sure, but the tech does have some value. And with a local AI you are in control, no one's logging your chats. No need for a massive data center. Everyone deserves access

https://microflare.bearblog.dev/introducing-microflare-v1/

#llm #ai #localAI #localLLM #openModels #qwen #microFlare #selfHosted

I've been working hard on a project for the past few weeks. I've made a custom version of Qwen 35B-A3B that is small enough to be run on just a 4GB GPU but still gives you high quality output.

People are abusing AI and it's overhyped sure, but the tech does have some value. And with a local AI you are in control, no one's logging your chats. No need for a massive data center. Everyone deserves access

https://microflare.bearblog.dev/introducing-microflare-v1/

#llm #ai #localAI #localLLM #openModels #qwen #microFlare #selfHosted

I've been working hard on a project for the past few weeks. I've made a custom version of Qwen 35B-A3B that is small enough to be run on just a 4GB GPU but still gives you high quality output.

People are abusing AI and it's overhyped sure, but the tech does have some value. And with a local AI you are in control, no one's logging your chats. No need for a massive data center. Everyone deserves access

https://microflare.bearblog.dev/introducing-microflare-v1/

#llm #ai #localAI #localLLM #openModels #qwen #microFlare #selfHosted

I've been working hard on a project for the past few weeks. I've made a custom version of Qwen 35B-A3B that is small enough to be run on just a 4GB GPU but still gives you high quality output.

People are abusing AI and it's overhyped sure, but the tech does have some value. And with a local AI you are in control, no one's logging your chats. No need for a massive data center. Everyone deserves access

https://microflare.bearblog.dev/introducing-microflare-v1/

#llm #ai #localAI #localLLM #openModels #qwen #microFlare #selfHosted