home.social

#local-models — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #local-models, aggregated by home.social.

fetched live
  1. Why the spread of powerful local AI models makes copyright enforcement even harder

    The central theme of Walled Culture the book (free digital versions available) is the growing incompatibility between traditional copyright law and the digital, online world. The culmination of that process was the EU Copyright Directive, passed in 2019. The Directive was supposed to be transposed into local laws by 2021, but a year after that deadline, many EU member states had failed to do […]

    #ai #article15 #cars #china #eu #euCopyrightDirective #fragmentation #genai #generativeAi #localModels #marketplace #openSource #openWeight #overblocking #redFlagAct #transparency #uk #uploadFilters walledculture.org/why-the-spre
  2. Why the spread of powerful local AI models makes copyright enforcement even harder

    The central theme of Walled Culture the book (free digital versions available) is the growing incompatibility between traditional copyright law and the digital, online world. The culmination of that process was the EU Copyright Directive, passed in 2019. The Directive was supposed to be transposed into local laws by 2021, but a year after that deadline, many EU member states had failed to do […]

    #ai #article15 #cars #china #eu #euCopyrightDirective #fragmentation #genai #generativeAi #localModels #marketplace #openSource #openWeight #overblocking #redFlagAct #transparency #uk #uploadFilters walledculture.org/why-the-spre
  3. Oh, look, another techie bragging about their overpowered Mac and their obsession with running local models that no one asked for 😂. Apparently, 2026 is the year when local models finally got "good," or maybe it's just another excuse to flex their RAM 💪. Who knew spending a fortune on hardware could make old tech "surprisingly good"? 🙄
    vickiboykis.com/2026/06/15/run #techbragging #localmodels #overpricedhardware #flexingRAM #2026tech #HackerNews #ngated

  4. Oh, look, another techie bragging about their overpowered Mac and their obsession with running local models that no one asked for 😂. Apparently, 2026 is the year when local models finally got "good," or maybe it's just another excuse to flex their RAM 💪. Who knew spending a fortune on hardware could make old tech "surprisingly good"? 🙄
    vickiboykis.com/2026/06/15/run #techbragging #localmodels #overpricedhardware #flexingRAM #2026tech #HackerNews #ngated

  5. Oh, look, another techie bragging about their overpowered Mac and their obsession with running local models that no one asked for 😂. Apparently, 2026 is the year when local models finally got "good," or maybe it's just another excuse to flex their RAM 💪. Who knew spending a fortune on hardware could make old tech "surprisingly good"? 🙄
    vickiboykis.com/2026/06/15/run #techbragging #localmodels #overpricedhardware #flexingRAM #2026tech #HackerNews #ngated

  6. Oh, look, another techie bragging about their overpowered Mac and their obsession with running local models that no one asked for 😂. Apparently, 2026 is the year when local models finally got "good," or maybe it's just another excuse to flex their RAM 💪. Who knew spending a fortune on hardware could make old tech "surprisingly good"? 🙄
    vickiboykis.com/2026/06/15/run #techbragging #localmodels #overpricedhardware #flexingRAM #2026tech #HackerNews #ngated

  7. Oh, look, another techie bragging about their overpowered Mac and their obsession with running local models that no one asked for 😂. Apparently, 2026 is the year when local models finally got "good," or maybe it's just another excuse to flex their RAM 💪. Who knew spending a fortune on hardware could make old tech "surprisingly good"? 🙄
    vickiboykis.com/2026/06/15/run #techbragging #localmodels #overpricedhardware #flexingRAM #2026tech #HackerNews #ngated

  8. RT @googlegemma: TRANSLASATION: Wir betreten ein neues Zeitalter der On-Device-Automatisierung. ✨ Sehen Sie, wie Gemma 4 E4B ein iOS-Simulator direkt über Argent navigiert und steuert. Lokale Modelle können komplexe Interaktionen und Software-Navigation autonom bewältigen. Video

    mehr auf Arint.info

    #AutonomousDriving #GemmaAI #iOSAutomation #LocalModels #OnDeviceAutomation #TechInnovation #arint_info

    https://x.com/googlegemma/status/2057570113390551452#m

  9. Wow, 13 minutes of your life you'll never get back, all to discover that you can run local models on an #M4 with a whopping #24GB of memory! 🥳 Next, maybe they'll tell us water is wet. 💧 So thrilling!
    jola.dev/posts/running-local-m #localmodels #memory #technews #thrilling #discoveries #HN #HackerNews #ngated

  10. Wow, 13 minutes of your life you'll never get back, all to discover that you can run local models on an #M4 with a whopping #24GB of memory! 🥳 Next, maybe they'll tell us water is wet. 💧 So thrilling!
    jola.dev/posts/running-local-m #localmodels #memory #technews #thrilling #discoveries #HN #HackerNews #ngated

  11. Wow, 13 minutes of your life you'll never get back, all to discover that you can run local models on an #M4 with a whopping #24GB of memory! 🥳 Next, maybe they'll tell us water is wet. 💧 So thrilling!
    jola.dev/posts/running-local-m #localmodels #memory #technews #thrilling #discoveries #HN #HackerNews #ngated

  12. Wow, 13 minutes of your life you'll never get back, all to discover that you can run local models on an #M4 with a whopping #24GB of memory! 🥳 Next, maybe they'll tell us water is wet. 💧 So thrilling!
    jola.dev/posts/running-local-m #localmodels #memory #technews #thrilling #discoveries #HN #HackerNews #ngated

  13. Wow, 13 minutes of your life you'll never get back, all to discover that you can run local models on an #M4 with a whopping #24GB of memory! 🥳 Next, maybe they'll tell us water is wet. 💧 So thrilling!
    jola.dev/posts/running-local-m #localmodels #memory #technews #thrilling #discoveries #HN #HackerNews #ngated

  14. Đang thử nghiệm MCP với trọng tâm là xác thực. Nếu bạn đang chạy mô hình cục bộ nhưng cần truy cập công cụ an toàn, cơ chế ánh xạ chứng thực của MCP có thể là giải pháp. Bạn nghĩ sao về cách tiếp cận "Direct Schema" so với "Toolkits"? #MCP #Authentication #LocalModels #AI #XácThực #MôHìnhCụcBộ #TríTuệNhânTạo

    v.redd.it/1jtvb3mi3xgg1

  15. 🛠️ Cộng đồng Ollama: Bạn gặp khó khăn khi chuyển prompt từ GPT‑4/Claude sang mô hình local? Các vấn đề: khác nhau về tuân thủ lệnh, system prompt, hỗ trợ function calling, kích thước context. Đang thảo luận cách viết lại, tìm phong cách “universal”, và công cụ chuyển đổi. Bạn dùng mô hình nào? Friction lớn nhất? Sẵn sàng thử converter nếu hỗ trợ local? #Ollama #PromptEngineering #AI #Mô_hình_local #Cộng_đồngAI #LocalModels

    reddit.com/r/ollama/comments/1

  16. 🚀 Người dùng tự xây dựng rig podcast vô hạn, chạy hoàn toàn trên RTX 5060 Ti, chỉ dùng Python + mô hình local, không cần OpenAI hay ElevenLabs. #AI #Podcast #LocalModels #CôngNghệ #PodcastVôHạn #RTX5060Ti #Python

    reddit.com/r/LocalLLaMA/commen

  17. 🤖 Đang chạy MCP với mô hình LLM cục bộ? Nhiều người gặp MCP hoạt động không ổn: cần quy tắc chặt chẽ, giả định mạng/đăng nhập không hợp, lỗi im lặng, workflow đa bước dễ gãy. Tác giả đã tổng hợp danh sách MCP dùng được, nơi thường lỗi & cách cải thiện. Bạn có MCP nào ổn với mô hình local? Chia sẻ kinh nghiệm nhé!
    #AI #LLM #LocalModels #MCP #Developer #TríTuệNhânTạo #MôHình #OpenSource

    reddit.com/r/LocalLLaMA/commen

  18. Một người dùng chia sẻ về việc tận dụng máy chủ cũ Dell PowerEdge R610 (2 CPU Xeon, 192GB RAM) để chạy mô hình AI cục bộ thay vì trả phí API. Họ đang tìm cách tự động hóa công việc và hỏi cộng đồng kinh nghiệm chạy mô hình AI trên phần cứng cũ. #AI #LocalModels #Hardware #TậnDụngMáyCũ #Học Máy

    reddit.com/r/ollama/comments/1

  19. Cập nhật template AI Full-stack v0.1.6: Hỗ trợ OpenRouter (kết nối mô hình địa phương), cải tiến CLI và nhiều sửa lỗi. Đúng dành cho người phát triển ứng dụng LLM! #AI #LocalModels #HọcMáyĐịaPhương #PhátTriểnPhầnMềm

    reddit.com/r/LocalLLaMA/commen

  20. Kỹ sư đảo ngược Tibor Blaho phát hiện chuỗi hệ thống quảng cáo trong phiên bản beta mới nhất của ChatGPT Android. Điều này có thể là một lý do nữa để người dùng ưu tiên các mô hình AI chạy cục bộ thay vì dịch vụ đám mây.

    #ChatGPT #AI #LocalModels #QuảngCáo #MôHìnhAI

    reddit.com/r/LocalLLaMA/commen

  21. 🆕 Học GGML ở đâu? 📚
    Muốn xây dựng các mô hình lớn với thư viện GGML cho sử dụng tại chỗ. Đã xem qua phần giới thiệu nhưng vẫn chưa rõ tiếp theo phải làm gì. Các ví dụ từ các triển khai như whisper.cpp, llama.cpp vẫn còn rất khó hiểu. Do thư viện đang trong quá trình phát triển nên chưa có tài liệu hướng dẫn chi tiết. Mục tiêu là chuyển đổi các mô hình được tạo ra từ các thư viện như Tensorflow, PyTorch hoặc VLLM sang GGML.

    Tags: #MachineLearning #GGML #LocalModels #HọcGGML #TensorFlow #PyTor

  22. @Catvalente

    Or just use you AI locally 🦾 💻 🧠

    I completely understand the concerns about relying too heavily on AI, especially cloud-based, centralized models like ChatGPT. The issues of privacy, energy consumption, and the potential for misuse are very real and valid. However, I believe there's a middle ground that allows us to benefit from the advantages of AI without compromising our values or autonomy.

    Instead of rejecting AI outright, we can opt for open-source models that run on local hardware. I've been using local language models (LLMs) on my own hardware. This approach offers several benefits:

    - Privacy - By running models locally, we can ensure that our data stays within our control and isn't sent to third-party servers.

    - Transparency - Open-source models allow us to understand how the AI works, making it easier to identify and correct biases or errors.

    - Customization - Local models can be tailored to our specific needs, whether it's for accessibility, learning, or creative projects.

    - Energy Efficiency - Local processing can be more energy-efficient than relying on large, centralized data centers.

    - Empowerment - Using AI as a tool to augment our own abilities, rather than replacing them, can help us learn and grow. It's about leveraging technology to enhance our human potential, not diminish it.

    For example, I use local LLMs for tasks like proofreading, transcribing audio, and even generating image descriptions. Instead of ChatGPT and Grok, I utilize Jan.ai with Mistral, Llama, OpenCoder, Qwen3, R1, WhisperAI, and Piper. These tools help me be more productive and creative, but they don't replace my own thinking or decision-making.

    It's also crucial to advocate for policies and practices that ensure AI is used ethically and responsibly. This includes pushing back against government overreach and corporate misuse, as well as supporting initiatives that promote open-source and accessible technologies.

    In conclusion, while it's important to be critical of AI and its potential downsides, I believe that a balanced, thoughtful approach can allow us to harness its benefits without sacrificing our values. Let's choose to be informed, engaged, and proactive in shaping the future of AI.

    CC: @Catvalente @audubonballroon
    @calsnoboarder @craigduncan

    #ArtificialIntelligence #OpenSource #LocalModels #PrivacyLLM #Customization #LocalAI #Empowerment #DigitalLiteracy #CriticalThinking #EthicalAI #ResponsibleAI #Accessibility #Inclusion #Education

  23. @Catvalente

    Or just use you AI locally 🦾 💻 🧠

    I completely understand the concerns about relying too heavily on AI, especially cloud-based, centralized models like ChatGPT. The issues of privacy, energy consumption, and the potential for misuse are very real and valid. However, I believe there's a middle ground that allows us to benefit from the advantages of AI without compromising our values or autonomy.

    Instead of rejecting AI outright, we can opt for open-source models that run on local hardware. I've been using local language models (LLMs) on my own hardware. This approach offers several benefits:

    - Privacy - By running models locally, we can ensure that our data stays within our control and isn't sent to third-party servers.

    - Transparency - Open-source models allow us to understand how the AI works, making it easier to identify and correct biases or errors.

    - Customization - Local models can be tailored to our specific needs, whether it's for accessibility, learning, or creative projects.

    - Energy Efficiency - Local processing can be more energy-efficient than relying on large, centralized data centers.

    - Empowerment - Using AI as a tool to augment our own abilities, rather than replacing them, can help us learn and grow. It's about leveraging technology to enhance our human potential, not diminish it.

    For example, I use local LLMs for tasks like proofreading, transcribing audio, and even generating image descriptions. Instead of ChatGPT and Grok, I utilize Jan.ai with Mistral, Llama, OpenCoder, Qwen3, R1, WhisperAI, and Piper. These tools help me be more productive and creative, but they don't replace my own thinking or decision-making.

    It's also crucial to advocate for policies and practices that ensure AI is used ethically and responsibly. This includes pushing back against government overreach and corporate misuse, as well as supporting initiatives that promote open-source and accessible technologies.

    In conclusion, while it's important to be critical of AI and its potential downsides, I believe that a balanced, thoughtful approach can allow us to harness its benefits without sacrificing our values. Let's choose to be informed, engaged, and proactive in shaping the future of AI.

    CC: @Catvalente @audubonballroon
    @calsnoboarder @craigduncan

    #ArtificialIntelligence #OpenSource #LocalModels #PrivacyLLM #Customization #LocalAI #Empowerment #DigitalLiteracy #CriticalThinking #EthicalAI #ResponsibleAI #Accessibility #Inclusion #Education

  24. @Catvalente

    Or just use you AI locally 🦾 💻 🧠

    I completely understand the concerns about relying too heavily on AI, especially cloud-based, centralized models like ChatGPT. The issues of privacy, energy consumption, and the potential for misuse are very real and valid. However, I believe there's a middle ground that allows us to benefit from the advantages of AI without compromising our values or autonomy.

    Instead of rejecting AI outright, we can opt for open-source models that run on local hardware. I've been using local language models (LLMs) on my own hardware. This approach offers several benefits:

    - Privacy - By running models locally, we can ensure that our data stays within our control and isn't sent to third-party servers.

    - Transparency - Open-source models allow us to understand how the AI works, making it easier to identify and correct biases or errors.

    - Customization - Local models can be tailored to our specific needs, whether it's for accessibility, learning, or creative projects.

    - Energy Efficiency - Local processing can be more energy-efficient than relying on large, centralized data centers.

    - Empowerment - Using AI as a tool to augment our own abilities, rather than replacing them, can help us learn and grow. It's about leveraging technology to enhance our human potential, not diminish it.

    For example, I use local LLMs for tasks like proofreading, transcribing audio, and even generating image descriptions. Instead of ChatGPT and Grok, I utilize Jan.ai with Mistral, Llama, OpenCoder, Qwen3, R1, WhisperAI, and Piper. These tools help me be more productive and creative, but they don't replace my own thinking or decision-making.

    It's also crucial to advocate for policies and practices that ensure AI is used ethically and responsibly. This includes pushing back against government overreach and corporate misuse, as well as supporting initiatives that promote open-source and accessible technologies.

    In conclusion, while it's important to be critical of AI and its potential downsides, I believe that a balanced, thoughtful approach can allow us to harness its benefits without sacrificing our values. Let's choose to be informed, engaged, and proactive in shaping the future of AI.

    CC: @Catvalente @audubonballroon
    @calsnoboarder @craigduncan

    #ArtificialIntelligence #OpenSource #LocalModels #PrivacyLLM #Customization #LocalAI #Empowerment #DigitalLiteracy #CriticalThinking #EthicalAI #ResponsibleAI #Accessibility #Inclusion #Education

  25. @Catvalente

    Or just use you AI locally 🦾 💻 🧠

    I completely understand the concerns about relying too heavily on AI, especially cloud-based, centralized models like ChatGPT. The issues of privacy, energy consumption, and the potential for misuse are very real and valid. However, I believe there's a middle ground that allows us to benefit from the advantages of AI without compromising our values or autonomy.

    Instead of rejecting AI outright, we can opt for open-source models that run on local hardware. I've been using local language models (LLMs) on my own hardware. This approach offers several benefits:

    - Privacy - By running models locally, we can ensure that our data stays within our control and isn't sent to third-party servers.

    - Transparency - Open-source models allow us to understand how the AI works, making it easier to identify and correct biases or errors.

    - Customization - Local models can be tailored to our specific needs, whether it's for accessibility, learning, or creative projects.

    - Energy Efficiency - Local processing can be more energy-efficient than relying on large, centralized data centers.

    - Empowerment - Using AI as a tool to augment our own abilities, rather than replacing them, can help us learn and grow. It's about leveraging technology to enhance our human potential, not diminish it.

    For example, I use local LLMs for tasks like proofreading, transcribing audio, and even generating image descriptions. Instead of ChatGPT and Grok, I utilize Jan.ai with Mistral, Llama, OpenCoder, Qwen3, R1, WhisperAI, and Piper. These tools help me be more productive and creative, but they don't replace my own thinking or decision-making.

    It's also crucial to advocate for policies and practices that ensure AI is used ethically and responsibly. This includes pushing back against government overreach and corporate misuse, as well as supporting initiatives that promote open-source and accessible technologies.

    In conclusion, while it's important to be critical of AI and its potential downsides, I believe that a balanced, thoughtful approach can allow us to harness its benefits without sacrificing our values. Let's choose to be informed, engaged, and proactive in shaping the future of AI.

    CC: @Catvalente @audubonballroon
    @calsnoboarder @craigduncan

    #ArtificialIntelligence #OpenSource #LocalModels #PrivacyLLM #Customization #LocalAI #Empowerment #DigitalLiteracy #CriticalThinking #EthicalAI #ResponsibleAI #Accessibility #Inclusion #Education

  26. @system76
    I love #LLM, or as they're often called, #AI, especially when used locally. Local models are incredibly effective for enhancing daily tasks like proofreading, checking emails for spelling and grammatical errors, quickly creating image descriptions, transcribing audio to text, or even finding that one quote buried in tons of files that answers a recurring question.

    However, if I wanted to be fully transparent to #bigtech, I would use Windows and Android with all the "big brotherly goodness" baked into them. That's why I hope these tools don't connect to third-party servers.

    So, my question to you is: Do you propose a privacy-oriented and locally/self-hosted first LLM?

    I'm not opposed to the general notion of using AI, and if done locally and open-source, I really think it could enhance the desktop experience. Even the terminal could use some AI integration, especially for spell-checking and syntax-checking those convoluted and long commands. I would love a self-hosted integration of some AI features. 🌟💻
    #OpenSource #Privacy #AI #LocalModels #SelfHosted #LinuxAI #LocalLLM #LocalAI

  27. @system76
    I love #LLM, or as they're often called, #AI, especially when used locally. Local models are incredibly effective for enhancing daily tasks like proofreading, checking emails for spelling and grammatical errors, quickly creating image descriptions, transcribing audio to text, or even finding that one quote buried in tons of files that answers a recurring question.

    However, if I wanted to be fully transparent to #bigtech, I would use Windows and Android with all the "big brotherly goodness" baked into them. That's why I hope these tools don't connect to third-party servers.

    So, my question to you is: Do you propose a privacy-oriented and locally/self-hosted first LLM?

    I'm not opposed to the general notion of using AI, and if done locally and open-source, I really think it could enhance the desktop experience. Even the terminal could use some AI integration, especially for spell-checking and syntax-checking those convoluted and long commands. I would love a self-hosted integration of some AI features. 🌟💻
    #OpenSource #Privacy #AI #LocalModels #SelfHosted #LinuxAI #LocalLLM #LocalAI

  28. @system76
    I love #LLM, or as they're often called, #AI, especially when used locally. Local models are incredibly effective for enhancing daily tasks like proofreading, checking emails for spelling and grammatical errors, quickly creating image descriptions, transcribing audio to text, or even finding that one quote buried in tons of files that answers a recurring question.

    However, if I wanted to be fully transparent to #bigtech, I would use Windows and Android with all the "big brotherly goodness" baked into them. That's why I hope these tools don't connect to third-party servers.

    So, my question to you is: Do you propose a privacy-oriented and locally/self-hosted first LLM?

    I'm not opposed to the general notion of using AI, and if done locally and open-source, I really think it could enhance the desktop experience. Even the terminal could use some AI integration, especially for spell-checking and syntax-checking those convoluted and long commands. I would love a self-hosted integration of some AI features. 🌟💻
    #OpenSource #Privacy #AI #LocalModels #SelfHosted #LinuxAI #LocalLLM #LocalAI

  29. @system76
    I love #LLM, or as they're often called, #AI, especially when used locally. Local models are incredibly effective for enhancing daily tasks like proofreading, checking emails for spelling and grammatical errors, quickly creating image descriptions, transcribing audio to text, or even finding that one quote buried in tons of files that answers a recurring question.

    However, if I wanted to be fully transparent to #bigtech, I would use Windows and Android with all the "big brotherly goodness" baked into them. That's why I hope these tools don't connect to third-party servers.

    So, my question to you is: Do you propose a privacy-oriented and locally/self-hosted first LLM?

    I'm not opposed to the general notion of using AI, and if done locally and open-source, I really think it could enhance the desktop experience. Even the terminal could use some AI integration, especially for spell-checking and syntax-checking those convoluted and long commands. I would love a self-hosted integration of some AI features. 🌟💻
    #OpenSource #Privacy #AI #LocalModels #SelfHosted #LinuxAI #LocalLLM #LocalAI

  30. Exciting developments in cybersecurity are paving the way for local models to bolster protection. Dive into this insightful article to explore the benefits and implications. #Cybersecurity #LocalModels #Innovation
    forbes.com/councils/forbestech