#gemma3n โ Public Fediverse posts
Live and recent posts from across the Fediverse tagged #gemma3n, aggregated by home.social.
-
In case anyone wants to run their own #LLM on their personal devices, I can suggest #lmstudio It allows you to download any major model that's out there to your own laptop/desktop, and then you can use it's Graphical Interface to interact with it in a familiar interface environment, as you would #Claude or #ChatGPT or #Gemini. It will also let you know if your device has enough resources (power) to run a specific model variant: https://lmstudio.ai/
For those of you who love the Terminal (aka: Command Line Interface or #CLI), check out https://ollama.com/
For starters, I suggest the #gemma3n model (works great on tablets, laptops, or phones), or #llama3.1 for the most common interactions. While most of us geeks will have very powerful personal systems, or servers in our home racks, most people do not have high-end systems/devices. The gemma3n model is lightweight, very powerful, and a solid general purpose LLM.
What's the benefit of running LLM's locally? #Privacy is a big one (it's running on your local machine, not a cloud server) - so you can ask it questions against sensitive business data, PHI/PII, etc.. You can also run it #offline (no Internet connection required) so if you wanted to #airgap your interactions, or play with it on vacation (on a plane, lost in the back country, etc.), you can absolutely do that - even with the Deepseek model.
I started playing with both LM Studio and ollama myself - been asking models basic questions like "what is the capital of Italy" and also more complex questions like "write me a #powershell script to add users of a specific OU to a number of Security Groups within AD" and so far, it's been very accurate. The PowerShell script llama3.1 provided worked out of the box (after I revised variables to match my environment).
-
๐ง Ho provato #Gemma3n in locale, su un laptop attraverso #Ollama e anche su #Colab.
๐ Com'รจ andata? https://www.linkedin.com/posts/alessiopomaro_gemma3n-ollama-colab-activity-7345330146146410496-0B1T
___
โ๏ธ ๐ฆ๐ฒ ๐๐๐ผ๐ถ ๐ฟ๐ถ๐บ๐ฎ๐ป๐ฒ๐ฟ๐ฒ ๐ฎ๐ด๐ด๐ถ๐ผ๐ฟ๐ป๐ฎ๐๐ผ/๐ฎ ๐๐ ๐พ๐๐ฒ๐๐๐ฒ ๐๐ฒ๐บ๐ฎ๐๐ถ๐ฐ๐ต๐ฒ, ๐ถ๐๐ฐ๐ฟ๐ถ๐๐ถ๐๐ถ ๐ฎ๐น๐น๐ฎ ๐บ๐ถ๐ฎ ๐ป๐ฒ๐๐๐น๐ฒ๐๐๐ฒ๐ฟ: https://bit.ly/newsletter-alessiopomaro
-
#Google has released #Gemma3n, an #open #AImodel designed for developers: It can process images, audio, video, and text inputs to generate text and is optimised for on-device use, requiring as little as #2GB of #memory. https://www.neowin.net/news/google-releases-gemma-3n-a-new-ai-model-built-for-mobile-devices/?AIagents.at #AIagent #AI #ML #NLP #LLM #GenAI
-
๐ฑ๐ค Brace yourselves, the overlords at Google have birthed "Gemma 3n," a "mobile-first" AIโeven though we all know it's just the same old repackaged Silicon Valley snake oil. But hey, slap "AI" on it, and it magically becomes 2023's digital duct tape. ๐โจ
https://developers.googleblog.com/en/introducing-gemma-3n/ #Gemma3n #AI #mobilefirst #SiliconValley #technews #digitalducttape #HackerNews #ngated -
๐ฑ๐ค Brace yourselves, the overlords at Google have birthed "Gemma 3n," a "mobile-first" AIโeven though we all know it's just the same old repackaged Silicon Valley snake oil. But hey, slap "AI" on it, and it magically becomes 2023's digital duct tape. ๐โจ
https://developers.googleblog.com/en/introducing-gemma-3n/ #Gemma3n #AI #mobilefirst #SiliconValley #technews #digitalducttape #HackerNews #ngated -
๐ฑ๐ค Brace yourselves, the overlords at Google have birthed "Gemma 3n," a "mobile-first" AIโeven though we all know it's just the same old repackaged Silicon Valley snake oil. But hey, slap "AI" on it, and it magically becomes 2023's digital duct tape. ๐โจ
https://developers.googleblog.com/en/introducing-gemma-3n/ #Gemma3n #AI #mobilefirst #SiliconValley #technews #digitalducttape #HackerNews #ngated -
๐ฑ๐ค Brace yourselves, the overlords at Google have birthed "Gemma 3n," a "mobile-first" AIโeven though we all know it's just the same old repackaged Silicon Valley snake oil. But hey, slap "AI" on it, and it magically becomes 2023's digital duct tape. ๐โจ
https://developers.googleblog.com/en/introducing-gemma-3n/ #Gemma3n #AI #mobilefirst #SiliconValley #technews #digitalducttape #HackerNews #ngated