#searchmysite — Public Fediverse posts

@strypey @zeh @alcinnz

Indeed mojeek.com is not the only non-tech-giant #searchEngine (+crawler). From strypey’s mentions + some of my notes:

* #Mojeek ← does their own crawling
* #Metager.org ← does their own crawling
* #SearchMySite.net ← avoid (Cloudflare)
* #Searx ← just proxy software, many instances
* #4get ← another proxy software, about a dozen instances: https://4get.ca/instances
* #Gigablast ← does their own crawling, but what happened?.. they were dissolved last year & seem to now be www.alltheinternet.com
* #Ombrelo ← a proxy but more advanced than the others (filters/downranks Cloudflare sites)

#YaCy is notable because it’s a crawler that you can install and operate yourself. YaCy instances can be public-facing and they can also share indexes with each other fedi style apparently. Some Searx instances tap YaCy instances.

I would love to find a searx or 4get instance that rejects the tech giants, but aggregates from YaCy, mojeek, gigablast, metager, maginalia.nu, frogfind.com, & wiby.me.

And I would love it even more if it would make replacements:

* #StackExchange → #AnonymousOverflow
* #YouTube → #Invideous
* #Medium.com → scribe.rip
* #BBC → BBC’s onion site
* #NYTimes → New York Times’s onion site
* etc.

search.fabiomanganiello.com makes some of those replacements.

@[email protected] @mattrambles @flamed @shellsharks Thanks for the #searchmysite mention:-)

#searchmysite redesign just launched thanks to its first major open source contributor: https://blog.searchmysite.net/posts/introducing-the-redesign-and-first-major-open-source-contributor/

@zeh @alcinnz I've been experimenting with a few search engines recently, including Mojeek, Metager.org, SearchMySite.net and the Searx instances at Monocles.de.

I've also figured out to how to configure my Firefox-based mobile browser to search for videos directly on YewTube (Invidio.us instance), and for green tech info on Appropedia.org, and I plan to add more sites to this (eg search.joinpeertube.org).

#Search #SearchEngines #Mojeek #Metager #SearchMySite #Searx #Monocles

Conoscete Searchmysite?

E' un motore di ricerca alternativo per siti web personali e indipendenti.

https://blog.getprivacy.it/searchmysite

#searchmysite #indiesearch #motoridiricerca #sitipersonali #hobby

Been a while, but I've just posted a short #searchmysite progress update: https://blog.searchmysite.net/posts/progress-update-q1-q2-2021/ . Short summary is that I've been reviewing submissions daily, fixed some minor bugs, and the system has been stable, but I've not had chance to do any enhancements. One interesting thing I've noticed is that I hardly get any hits from Google: anyone have any idea why?

I've summarised how much searchmysite.net (the open source search engine and search as a service) has cost over the past 6 months, and estimated how much it may cost to keep going in future: https://blog.searchmysite.net/posts/searchmysite.net-the-delicate-matter-of-the-bill/ Short summary: it is (perhaps) surprisingly expensive to run a search engine and search as a service. The good news is that there is a plan to cover costs (without resorting to advertising). Let's see if it works. #searchmysite

I decided to expand my last toot about advertising and search engines into a full blog post: https://blog.searchmysite.net/posts/advertising-and-search-engines-when-it-is-okay-to-mix-and-when-it-is-not/ #searchmysite

searchmysite.net is now open source: https://blog.searchmysite.net/posts/searchmysite.net-is-now-open-source/ . Post includes: Why aren’t other search engines open source? What open source licence is it? What are the future plans? #searchmysite

This post contains details of the most recent round of relevancy tuning for searchmysite.net, completed following user feedback and the submission of many more sites. It is possible to detail how results are ranked because of the model designed to keep out and remove the financial incentive for spam: https://blog.searchmysite.net/posts/relevancy-tuning-for-searchmysite.net/ #searchmysite

searchmysite.net has its own dedicated blog now, and I've posted a bit more details of some of the changes I've made since the burst of activity in mid October at https://blog.searchmysite.net/posts/improving-stability-and-fixing-issues-on-searchmysite.net/ #searchmysite

There has been a slight mismatch between the number of sites submitted, and the number indexed. Turns out that 10 sites have a User-agent: * Disallow: / in their robots.txt. I've added those sites to the do not index list, which means if you resubmit them you'll see the message '... has previously been submitted but ... Access blocked by robots.txt'. If you see this, but have updated robots.txt to allow searchmysite.net, let me know and I'll move to the index list again. #searchmysite