#recoll — Public Fediverse posts

The debate about #localai is kinda amusing. On the one hand prudent people that want private, local inference of #opensource #llm be the norm, on the other, "AI" psychos that can no longer imagine life without access to "SOTA"

Running these gargantuan models locally is currently barely possible in high end desktops. But there is vast space of less demanding tools that we could have on #linux and we don't.

For the longest time the only project in this space has been amazing #recoll / #xapian

Les documentalistes et archivistes ont probablement des outils, propositions, suggestions, solutions.
(localement sur ordi j'utilise Recoll)
#archiviste #documentaliste #information #culture #Recoll #documentation #archivistodon

Bon #Linux j'ai tout essayé pour faire fonctionner #OCR dans #Recoll ...

En ajoutant des bon paramètres dans Recoll.conf idem dans mimetorf. Rien à faire.

Y'en a qui on déjà essayé de le faire ?

Il semble que pyexiv2 fasse une erreur et même avec une demande pour skip et passer direct à execm rclimg.py

@lascapi + #recoll for search in local library and aggregate everything using private instance of #searxng

@WorziArmin Ein Kollege hatte schon mal Tools fürs #Dokumentenmanagement vorgestellt. Aber ich fürchte: Das erfordert noch mehr Disziplin. #OCRmyPDF kann das Problem nicht lösen, das scannt ja nur ein und macht die Texterkennung. Für alle, die keine Lust haben zu sortieren, empfehle ich tatsächlich #Recoll. Festplatte indizieren, dann findet das fast alles. Aber mich würde das Chaos auf der Festplatte irre machen.

Datei und Volltext-Suche ist ja immer so ein Ding. Unter Windows haben wir für Netzlaufwerke #DocFetcher (https://docfetcher.sourceforge.io/de/) genommen. Aber es hat so Stabilitätsprobleme.

Das #Recoll (https://www.recoll.org) sieht auch interessant aus. Er ist aber noch beim Indizieren lokal gerade.

Bisher hatte ich #FSearch als #Everything-Alternative unter Linux. Aber Volltext-Index ist natürlich auch nett

Jetzt seh ich gerade auch noch #SearchMonkey (https://sourceforge.net/projects/searchmonkey/)...

Datei und Volltext-Suche ist ja immer so ein Ding. Unter Windows haben wir für Netzlaufwerke #DocFetcher (https://docfetcher.sourceforge.io/de/) genommen. Aber es hat so Stabilitätsprobleme.

Das #Recoll (https://www.recoll.org) sieht auch interessant aus. Er ist aber noch beim Indizieren lokal gerade.

Bisher hatte ich #FSearch als #Everything-Alternative unter Linux. Aber Volltext-Index ist natürlich auch nett

Jetzt seh ich gerade auch noch #SearchMonkey (https://sourceforge.net/projects/searchmonkey/)...

Datei und Volltext-Suche ist ja immer so ein Ding. Unter Windows haben wir für Netzlaufwerke #DocFetcher (https://docfetcher.sourceforge.io/de/) genommen. Aber es hat so Stabilitätsprobleme.

Das #Recoll (https://www.recoll.org) sieht auch interessant aus. Er ist aber noch beim Indizieren lokal gerade.

Bisher hatte ich #FSearch als #Everything-Alternative unter Linux. Aber Volltext-Index ist natürlich auch nett

Jetzt seh ich gerade auch noch #SearchMonkey (https://sourceforge.net/projects/searchmonkey/)...

Datei und Volltext-Suche ist ja immer so ein Ding. Unter Windows haben wir für Netzlaufwerke #DocFetcher (https://docfetcher.sourceforge.io/de/) genommen. Aber es hat so Stabilitätsprobleme.

Das #Recoll (https://www.recoll.org) sieht auch interessant aus. Er ist aber noch beim Indizieren lokal gerade.

Bisher hatte ich #FSearch als #Everything-Alternative unter Linux. Aber Volltext-Index ist natürlich auch nett

Jetzt seh ich gerade auch noch #SearchMonkey (https://sourceforge.net/projects/searchmonkey/)...

Datei und Volltext-Suche ist ja immer so ein Ding. Unter Windows haben wir für Netzlaufwerke #DocFetcher (https://docfetcher.sourceforge.io/de/) genommen. Aber es hat so Stabilitätsprobleme.

Das #Recoll (https://www.recoll.org) sieht auch interessant aus. Er ist aber noch beim Indizieren lokal gerade.

Bisher hatte ich #FSearch als #Everything-Alternative unter Linux. Aber Volltext-Index ist natürlich auch nett

Jetzt seh ich gerade auch noch #SearchMonkey (https://sourceforge.net/projects/searchmonkey/)...

🗂️ My computer stores everything I work with: drafts, notes, datasets, scripts, models, simulations results, old archives — and, of course, a ridiculous amount of literature. 😅

Recently I discovered something that felt like unlocking a hidden level: local full-text search.

I’d used basic search tools before, but then I tried Recoll — an open-source search engine for UNIX-like systems — and it completely changed how I navigate my research files.

It honestly feels like I found a new kind of “computer game,” and I’ll probably keep playing with it for months. 🤣

#ResearchWorkflow #IndependentResearch #DataManagement #OpenSource #KnowledgeOrganization #UNIX #DigitalResearch #ResearchTools #Recoll #KnowledgeManagement #Linux #FOSS

🗂️ My computer stores everything I work with: drafts, notes, datasets, scripts, models, simulations results, old archives — and, of course, a ridiculous amount of literature. 😅

Recently I discovered something that felt like unlocking a hidden level: local full-text search.

I’d used basic search tools before, but then I tried Recoll — an open-source search engine for UNIX-like systems — and it completely changed how I navigate my research files.

It honestly feels like I found a new kind of “computer game,” and I’ll probably keep playing with it for months. 🤣

#ResearchWorkflow #IndependentResearch #DataManagement #OpenSource #KnowledgeOrganization #UNIX #DigitalResearch #ResearchTools #Recoll #KnowledgeManagement #Linux #FOSS

🗂️ My computer stores everything I work with: drafts, notes, datasets, scripts, models, simulations results, old archives — and, of course, a ridiculous amount of literature. 😅

Recently I discovered something that felt like unlocking a hidden level: local full-text search.

I’d used basic search tools before, but then I tried Recoll — an open-source search engine for UNIX-like systems — and it completely changed how I navigate my research files.

It honestly feels like I found a new kind of “computer game,” and I’ll probably keep playing with it for months. 🤣

#ResearchWorkflow #IndependentResearch #DataManagement #OpenSource #KnowledgeOrganization #UNIX #DigitalResearch #ResearchTools #Recoll #KnowledgeManagement #Linux #FOSS

🗂️ My computer stores everything I work with: drafts, notes, datasets, scripts, models, simulations results, old archives — and, of course, a ridiculous amount of literature. 😅

Recently I discovered something that felt like unlocking a hidden level: local full-text search.

I’d used basic search tools before, but then I tried Recoll — an open-source search engine for UNIX-like systems — and it completely changed how I navigate my research files.

It honestly feels like I found a new kind of “computer game,” and I’ll probably keep playing with it for months. 🤣

#ResearchWorkflow #IndependentResearch #DataManagement #OpenSource #KnowledgeOrganization #UNIX #DigitalResearch #ResearchTools #Recoll #KnowledgeManagement #Linux

🗂️ My computer stores everything I work with: drafts, notes, datasets, scripts, models, simulations results, old archives — and, of course, a ridiculous amount of literature. 😅

Recently I discovered something that felt like unlocking a hidden level: local full-text search.

I’d used basic search tools before, but then I tried Recoll — an open-source search engine for UNIX-like systems — and it completely changed how I navigate my research files.

It honestly feels like I found a new kind of “computer game,” and I’ll probably keep playing with it for months. 🤣

#ResearchWorkflow #IndependentResearch #DataManagement #OpenSource #KnowledgeOrganization #UNIX #DigitalResearch #ResearchTools #Recoll #KnowledgeManagement #Linux

Die Tool-Chain hat nun Zuwachs bekommen:

#Recoll mit den Paketen #untex und #pdftotext sorgt nun dafür, dass in allen Dokumenten effizient gesucht werden kann.

https://github.com/ArkThis/AHAlodeck/blob/main/res/0byte-db_entry.png

#xattr #linux #ext4 #zfs #samba #smb

Right-click-edit-metadata happily in-use over 1 year now: Amazing!

#AHAlodeck #Recoll #SENlabs

Ainda sobre a #TerSoftware de hoje, sabem qual outro programa eu indicaria para quem lida com documentos e precisa de uma forcinha no gerenciamento? O #Recoll.

O Recoll é um poderoso indexador baseado na biblioteca Xapian. A interface, feita com o toolkit Qt, é relativamente fácil de usar, mas fica ainda melhor se a busca utilizar um pouco da sintaxe de busca, facilitando pesquisas por tipo MIME ou pelo nome do diretório no qual os arquivos foram armazenados.

Para arquivos PDF, o Recoll oferece preview em texto simples, snippets para contextualizar os resultados da busca e a possibilidade de abrir o visualizador já na página correta.

O binário `recollq` (ou `recoll -t`) pode ser usado via linha de comando, o que amplia o leque de possibilidades com scripts.

O Recoll me ajuda bastante quando preciso pesquisar minha biblioteca de teses, dissertações e artigos. Facilita muito para trabalhos acadêmicos.

Why hadn't I used #recoll in so many years! It is such a wonderful package, full text search that works like a charm and is built solidly. As a bonus there is an #emacs package for it too.

#Recoll currently too often takes up too much ressources. I used it many years now. But if it uses 120% CPU for 1-2 hours its not okay any more. Search for an alternative

#LinuxDesktopSearch

#Recoll currently too often takes up too much ressources. I used it many years now. But if it uses 120% CPU for 1-2 hours its not okay any more. Search for an alternative

#LinuxDesktopSearch

#Recoll currently too often takes up too much ressources. I used it many years now. But if it uses 120% CPU for 1-2 hours its not okay any more. Search for an alternative

#LinuxDesktopSearch

I am a rulebook hoarder. Whenever I take a closer look at a game downloading the rulebook is the first thing I do. I have over 2500 boardgame related pdf files. I access them using pdf-tools in #Emacs, index them using #recoll and I use a small hack to make M-x pdfgrep search using the recoll index. I use the #OCRmyPDF tool to OCR the ones that didn't come with embedded text.
#boardgames

I repurposed one of his old laptops (that overheats, sadly) as frontend, making room for an Ubuntu partition.
I installed the trusty #recoll to index text documents and emails.
For images, I ended up using #KPhotoAlbum, that has very flexible tagging possibilities, making it useful on more than photo albums. Chronological view and image stacking are also great.
I used #Geeqie, then more recently #Czkawka for finding image #duplicates, that I then stacked manually in KPhotoAlbum.

Damn, #Recoll can be a real life-saver if you're looking for a document in your pile of (hidden) folders/emails/attachments/etc. It indexes pretty much everything and helps dig up stuff. Neat!

https://www.lesbonscomptes.com/recoll/pages/index-recoll.html

Just like I am a fan of desktop search engines like #Recoll (bringing the power of something like Google to my own personal data), I am excited about the potential of the application of LLMs like #ChatGPT *[Footnote1] to my own library of articles, books and notes.

"Show me who has written about the rise of ecofascism in 1930s in Germany, and summarize my notes on it."

Something like this: https://org-roam.discourse.group/t/a-demo-of-ai-for-linking-writing-and-thinking-with-org-roam-should-we-build-org-roam-ai/2891?u=misha

There you go: https://codeberg.org/Letterus/synapse-project/releases @Codeberg

#Debian and #Ubuntu packages available @opensuse build service. I'm quite happy I now could install this package on my office machine and I'm finding my documents immediately, getting them presented in a pretty way! #Recoll #Synapse #Zeitgeist #FullText #Search

Okay, #Debian #Packaging now. Bwah, I hate it. I probably gonna postpone it to next year. 😁 #Synapse #plugin #Recoll

I think I improved the code by setting a timeout so that #Recoll will only be called when the user stops typing. As you can see via the logged lines in the terminal window this reduces the number of calls to Recall massively and thus the load on the machine. #Synapse

Code is here @Codeberg: https://codeberg.org/Letterus/synapse-project/src/branch/recoll_integration/src/plugins/recoll-plugin.vala

Since this is my first time doing concurrent/async programming in #Vala I'm grateful for comments helping to improve those lines. 😉

To add some more information here: This (German) wiki entry provides information which #Debian #packages to install to make #Recoll perform best: https://wiki.ubuntuusers.de/Recoll/

And this article of #LinuxMagazine provides an in-depth explanation of the features of Recoll and why it should be preferred over using #Xapian directly for handling user provided search strings: https://www.linux-magazine.com/Issues/2018/212/Tutorials-Recoll

So, this already looks very promising. #synapse #recoll #integration #endOfTheYearHacking
Time to create a new @Codeberg repo and make a #Debian #package this evening I think.

So, my #FLOSS todo list for the next days:
- get that #Recoll plugin for #Synapse working again
- write that script to make @qownnotes use @pandoc and @libreoffice to generate a PDF booklet
- make that #iBook G4 running again and set up an usable PIM suite using #vdirsyncer, #khal, #khard and #mutt.

If I'm somewhat recreated by that time I'm gonna restart coding on #ObjGTK. But after Christmas I'm really too exhausted to get into deep work too soon. 🤔 🤷‍♂️

So, my #FLOSS todo list for the next days:
- get that #Recoll plugin for #Synapse working again
- write that script to make @qownnotes use @pandoc and @libreoffice to generate a PDF booklet
- make that #iBook G4 running again and set up an usable PIM suite using #vdirsyncer, #khal, #khard and #mutt.

If I'm somewhat recreated by that time I'm gonna restart coding on #ObjGTK. But after Christmas I'm really too exhausted to get into deep work too soon. 🤔 🤷‍♂️

So, my #FLOSS todo list for the next days:
- get that #Recoll plugin for #Synapse working again
- write that script to make @qownnotes use @pandoc and @libreoffice to generate a PDF booklet
- make that #iBook G4 running again and set up an usable PIM suite using #vdirsyncer, #khal, #khard and #mutt.

If I'm somewhat recreated by that time I'm gonna restart coding on #ObjGTK. But after Christmas I'm really too exhausted to get into deep work too soon. 🤔 🤷‍♂️

So, my #FLOSS todo list for the next days:
- get that #Recoll plugin for #Synapse working again
- write that script to make @qownnotes use @pandoc and @libreoffice to generate a PDF booklet
- make that #iBook G4 running again and set up an usable PIM suite using #vdirsyncer, #khal, #khard and #mutt.

If I'm somewhat recreated by that time I'm gonna restart coding on #ObjGTK. But after Christmas I'm really too exhausted to get into deep work too soon. 🤔 🤷‍♂️

So, my #FLOSS todo list for the next days:
- get that #Recoll plugin for #Synapse working again
- write that script to make @qownnotes use @pandoc and @libreoffice to generate a PDF booklet
- make that #iBook G4 running again and set up an usable PIM suite using #vdirsyncer, #khal, #khard and #mutt.

If I'm somewhat recreated by that time I'm gonna restart coding on #ObjGTK. But after Christmas I'm really too exhausted to get into deep work too soon. 🤔 🤷‍♂️

Can anyone #recommend a full-text, indexing search for #debian #linux? It seems like there's no singular solution, like Spotlight on OSX.

I have #Akonadi and #Tracker3 running. I've considered #Recoll and #SOLR.

In practice, I wind up using #grep and locate. Grep is a a worst-case personal search engine.

Bonus points if it doesn't require lots of config and if it is lightweight when idle.

This should be easy in 2022. Right?

@nobodyinperson I keep them separated. I organize literature via #Zotero. Sometimes I use #Recoll when I look for a specific information in my library. When I write papers I make a snapshot of the papers a I want so cite. That is when I use #kbibtex alot in combination with #RKWard.

@brecht @floppy That sounds like a good line of thought, however storing the contents is also needed for full text search, and that's precisely what search engines have been doing for this whole millennium without much legal fuss.

The difficulty only came recently with snippets, which are all about showing the contents to some party other than the one which did the scraping.

I think my setup for search and saving using #Recoll-we and #singlefileZ is legally safe.

@brecht @floppy That sounds like a good line of thought, however storing the contents is also needed for full text search, and that's precisely what search engines have been doing for this whole millennium without much legal fuss.

The difficulty only came recently with snippets, which are all about showing the contents to some party other than the one which did the scraping.

I think my setup for search and saving using #Recoll-we and #singlefileZ is legally safe.

@ashshuota SingleFileZ, which saves to a place indexed by #Recoll.

#Recoll is a personal #search engine.

Recoll indexes and searches directories using #Xapian. Recoll performs full text searches, meaning the entire text of indexed files is searched rather than some metadata. Recoll supports helpers which can perform spell check, indexing of otherwise unsupported file formats, and plenty more. Recoll supports fuzzy suggestions based on the actual contents of the index.

Website 🔗️: https://www.lesbonscomptes.com/recoll/

apt 📦️: recoll

#free #opensource #foss #fossmendations