#privategpt — Public Fediverse posts

Справочник по стандартам ЕСКД при помощи RAG на PrivateGPT

Я работал одно время в сфере машиностроения. В авиации, если точнее. И когда надо было соблюсти формальности или пройти нормоконтроль, приходилось разбираться в нормативной документации. И приходилось, собственно говоря, нечасто, поэтому все это "добро" регулярно забывалось. Теперь, поскольку есть множество простейших способов создать RAG, я решил узнать, будет ли выдавать приемлемые результаты такая реализация. Сделал черновой вариант справочника - в нем лишь пара стандартов из тех, которые бы мне хотелось иметь в справочнике. Создание RAG по нескольким стандартам займет большее время на доработку данных. В целом, неплохо работает. Истории сообщений и переключения истории чатов с RAG ассистентом в UI PrivateGPT нет. Интерфейс довольно простой. Вот он:

https://habr.com/ru/articles/899384/

#privategpt #rag #ескд

https://itsfoss.com/local-ai-docs-tools/

5 Locally run AI/LLM tools for working with PDF's

- Chatd
- localGPT
- PrivateGPT
- GPT4All
- LM Studio

The article discusses each tool in detail, some performing various tasks better than others, and some which have very specific usages.

As these all run locally, you have a greater guarantee of Privacy & control over the models, as well as less environmental impact.

#AI #LLM #PDF #ChatD #LocalGPT #PrivateGPT #GPT4ALL #LMStudio

Tested #Mixtral8x7b #LLM in #AI "lab". Amazing precise answers about private documents. Something like #PrivateGPT / #LocalGPT but way better. Sadly, can't host publicly.
Already full of ideas for #business cases.
Now, I need €€€€... €, to get hardware for homelab 😎🤣💶💶💶

Well, I finally did some blogging / wrote an article outside of work again....

Interested in my experiences with running local #LLMs and integrating them into routine workflows?

"No Cloud In Sight: Augmented Intelligence for Privacy-Centric Workflows"

https://medium.com/@mreinwarth/no-cloud-in-sight-augmented-intelligence-for-privacy-centric-workflows-6930d67ba52d

#localLLMs #efficiency #augmentedIntelligence #ollama #fabric #privateGPT

Well, I finally did some blogging / wrote an article outside of work again....

Interested in my experiences with running local #LLMs and integrating them into routine workflows?

"No Cloud In Sight: Augmented Intelligence for Privacy-Centric Workflows"

https://medium.com/@mreinwarth/no-cloud-in-sight-augmented-intelligence-for-privacy-centric-workflows-6930d67ba52d

#localLLMs #efficiency #augmentedIntelligence #ollama #fabric #privateGPT

Запускаем PrivateGPT на GPU AMD Radeon в Docker

PrivateGPT — это проект, который расширяет возможности работы LLM-моделей, позволяя добавлять неограниченное количество личных данных. 31 октября 2023 AMD Radeon предоставила поддержку PyTorch для любительских видеокарт. Полный список видеокарт и ОС можно посмотреть здесь . Описанная инструкция протестирована на AMD Radeon RX 7900 XTX. Для запуска нам понадобится Ubuntu с установленными: git, make, docker и ROCm.

https://habr.com/ru/articles/807469/

#privategpt #radeon #ai #ии #машинное+обучение #amd #rx_7900_xtx #docker #rocm

https://itsfoss.com/local-ai-docs-tools/

5 Locally run AI/LLM tools for working with PDF's

- Chatd
- localGPT
- PrivateGPT
- GPT4All
- LM Studio

The article discusses each tool in detail, some performing various tasks better than others, and some which have very specific usages.

As these all run locally, you have a greater guarantee of Privacy & control over the models, as well as less environmental impact.

#AI #LLM #PDF #ChatD #LocalGPT #PrivateGPT #GPT4ALL #LMStudio

https://itsfoss.com/local-ai-docs-tools/

5 Locally run AI/LLM tools for working with PDF's

- Chatd
- localGPT
- PrivateGPT
- GPT4All
- LM Studio

The article discusses each tool in detail, some performing various tasks better than others, and some which have very specific usages.

As these all run locally, you have a greater guarantee of Privacy & control over the models, as well as less environmental impact.

#AI #LLM #PDF #ChatD #LocalGPT #PrivateGPT #GPT4ALL #LMStudio

https://itsfoss.com/local-ai-docs-tools/

5 Locally run AI/LLM tools for working with PDF's

- Chatd
- localGPT
- PrivateGPT
- GPT4All
- LM Studio

The article discusses each tool in detail, some performing various tasks better than others, and some which have very specific usages.

As these all run locally, you have a greater guarantee of Privacy & control over the models, as well as less environmental impact.

#AI #LLM #PDF #ChatD #LocalGPT #PrivateGPT #GPT4ALL #LMStudio

https://itsfoss.com/local-ai-docs-tools/

5 Locally run AI/LLM tools for working with PDF's

- Chatd
- localGPT
- PrivateGPT
- GPT4All
- LM Studio

The article discusses each tool in detail, some performing various tasks better than others, and some which have very specific usages.

As these all run locally, you have a greater guarantee of Privacy & control over the models, as well as less environmental impact.

#AI #LLM #PDF #ChatD #LocalGPT #PrivateGPT #GPT4ALL #LMStudio

Tested #Mixtral8x7b #LLM in #AI "lab". Amazing precise answers about private documents. Something like #PrivateGPT / #LocalGPT but way better. Sadly, can't host publicly.
Already full of ideas for #business cases.
Now, I need €€€€... €, to get hardware for homelab 😎🤣💶💶💶

Tested #Mixtral8x7b #LLM in #AI "lab". Amazing precise answers about private documents. Something like #PrivateGPT / #LocalGPT but way better. Sadly, can't host publicly.
Already full of ideas for #business cases.
Now, I need €€€€... €, to get hardware for homelab 😎🤣💶💶💶

Tested #Mixtral8x7b #LLM in #AI "lab". Amazing precise answers about private documents. Something like #PrivateGPT / #LocalGPT but way better. Sadly, can't host publicly.
Already full of ideas for #business cases.
Now, I need €€€€... €, to get hardware for homelab 😎🤣💶💶💶

Privāts GPT “čatojot” ar taviem dokumentiem (#ai)

Izmēģināju uz pirmajiem dokumentiem – Latvijas Satversmi. Un patiešām – mācēja pārfrāzēt un atrast arī pēc vārdiem, kas tiešā veidā nav minēti tekstā, bet apzīmē noteiktu domu, vienlaicīgi mācēja arī izveidot kopsavilkumu. Arī laiks kādā izpildās vaicājums ir pieņemams

#ai #ai-tests #chatgpt #datu-analize #datu-zinatne #gpt #llm #localgpt #maksligais-intelekts #nlp #openai #privategpt #python

https://rolandinsh.lv/privats-gpt-catojot-ar-taviem-dokumentiem/

[Перевод] Запускаем privateGPT локально на WSL c поддержкой GPU Nvidia

Приватный GPT - это готовый к производству проект искусственного интеллекта, который позволяет задавать вопросы о ваших документах, используя мощь больших языковых моделей (LLM), даже в сценариях без подключения к Интернету. 100% приватный, никакие данные не покидают ваше окружение выполнения в любой момент. Запуск на Windows Subsystem для Linux (WSL) с поддержкой GPU может значительно улучшить его производительность. В этом руководстве я проведу вас пошаговый процесс установки PrivateGPT на WSL с использованием ускорения GPU.

https://habr.com/ru/articles/800697/

#privateGPT #nvidia #AI #ИИ #ии_и_машинное_обучение

Setting Up #PrivateGPT to Use #Ai Chat With Your Documents

https://itsfoss.com/privategpt-setup/

https://itsfoss.com/privategpt-setup/

PrivateGPT is a free and open-source AI. In this article, you can learn how to set up a local copy, and use it to help you read, & understand documents without sending a ton of info back to some company.

#AI #LLM #PrivateGPT #Technology #Software #Linux

Фаерфокс тестує доповнення локального штучного інтелекту.
#фаерфокс #мозіла #браузер #mozilla #firefox #browser #privateGPT #ai #ші #AI_Firefox
https://pobachyty.blogspot.com/2024/01/eksperementanyj-dodatok-shi-firefox.html

Researching using a private #LLM implemented beside existing search. #Laravel of course, must be a private model, thinking larachain.io with #PrivateGPT? Not talking tons of data, perhaps only a few MB to start with.

Would love to hear from others doing or trying to do similar. I’ve currently zero experience in setting up and implementing LLMs. 😬

How to leverage AI to generate Apache Camel routes | Red Hat Developer https://developers.redhat.com/articles/2023/08/24/how-leverage-ai-generate-apache-camel-routes
#privategpt #Camel #Java

@taiyo

(1/2)

Thank you for your kind response.

I am very pleased to hear that. Even if the advent of a #AGI might be inevitable (1), at least it should not be controlled by a few multinational companies.

I would be pleased to learn more about your country's approach in the future.

What do you think about #PrivateGPT, if I may ask?

Also, as a thought, I have experienced tremendous help from the #FOSS community here; in particular #Linux.

Having a similar #AI...

@leadb @timnitGebru

(3/3)

...
One of my chief hypothesis is (see linked thread above at the end) is that the next evolutionary quantum-leap for #AI will be #embodiment. This can be explained by #SystemsTheory (#Luhmann et al) and other social sciences:

https://mastodon.social/@HistoPol/110485223389507009

Last, but not least, #PrivateGPT is on the rise and that requires only a gaming PC, not data-centers.

I have set up #privateGPT ( https://github.com/imartinez/privateGPT ) with llama.cpp 13B, but find the quality of the output underwhelming. I have built vector databases for scientific abstracts and from scientific book chapters. The responses are hit and miss.