#mojeek — Public Fediverse posts

De fem stora IT-företagen som kontrollerar programvaran på våra datorer, hur vi använder internet och våra sociala medier är Alphabet (Google), Amazon, Apple, Microsoft och Meta Platforms (Facebook). Det finns mängder med europeiska alternativ som i flera fall är fri och öppen programvara men i andra fall är proprietär program (ägd och sluten) vara eller tjänster.

What are all global web #search engines with own #index?

I don't mean country specific ones like #Yandex , #Baidu, #Naver or #Seznam

But global like #Google , #Bing , #Brave search, #Mojeek , PriEco , mwmbl

https://social.emucafe.org/naferrell/blocking-independent-search-crawlers-07-17-25/

I read an interesting Hacker News comment by user dumbfounder (great username!) on Hacker News today. I excerpt the pertinent part below:

I created a search engine that crawled the web way back in 2003. I used a proper user agent that included my email address. I got SO many angry emails about my crawler, which played as nice as I was able to make it play. Which was pretty nice I believe. If it’s not Google people didn’t want it. That’s a good way to prevent anyone from ever competing with Google.

dumbfounder

I have had problems with bad crawlers (especially bad AI cralwers) on my sites. At the same time, dumbfounder highlights the reverse side of the coin. Many sites block good crawlers such as robots.txt-respecting crawlers for indepdent search engines. While all webmasters are free to control access to their sites as they see fit, allowing Google and other select big tech search crawlers while excluding small and independent search crawlers both limits search diversity and prevents people who may rely on small or niche search engines such as Mojeek, Marginalia, or Seznam from discovering potentially interesting writing. I previously published an article on this issue advocating for webmasters who want to support an open web and search engine diversity to ensure that good crawlers from independent search engines and directories can access their sites.

#bots #googleSearch #marginaliaSearch #mojeek #searchEngines #seznam

https://ec.europa.eu/commission/presscorner/detail/en/ip_23_4328

#tech #DMA #DigitalMarketsAct #Google #Android #Apple #Amazon #Facebook #Meta #TikTok #Bytedance #EC #EuropeanCommission #androiddeveloper #androiddevelopment #opensource #privacy #ESG #competition #eos #Murena #ospo #graphhopper #stadiamaps #MapLibre #QwantMaps #OsmAnd #OrganicMaps #OpenStreetMap #Mojeek #OpenReviews #Maptiler #NextcloudMaps #Leaflet