#openwebsearcheu — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #openwebsearcheu, aggregated by home.social.
-
Paper:
https://doi.org/10.1007/978-3-032-21289-4_25Want to try it yourself?
#openwebsearcheu book chapter:
https://openwebsearcheu-public.pages.it4i.eu/ows-the-book/content/dnt/remote-index.htmlCode repository for running remote queries using #DuckDB
https://gitlab.science.ru.nl/informagus/remote-querying -
Paper:
https://doi.org/10.1007/978-3-032-21289-4_25Want to try it yourself?
#openwebsearcheu book chapter:
https://openwebsearcheu-public.pages.it4i.eu/ows-the-book/content/dnt/remote-index.htmlCode repository for running remote queries using #DuckDB
https://gitlab.science.ru.nl/informagus/remote-querying -
Gijs Hendriksen presenting our work on "remote querying" to provide access to huge Web resources through de facto standard tech: Parquet files in S3 queried using #DuckDB to facilitate IR research at very acceptable latencies.
Run your ClueWeb experiment in 10 minutes or so, and repeat your experiments on recent Web data from the #openwebsearcheu Open Web Index.
-
Gijs Hendriksen presenting our work on "remote querying" to provide access to huge Web resources through de facto standard tech: Parquet files in S3 queried using #DuckDB to facilitate IR research at very acceptable latencies.
Run your ClueWeb experiment in 10 minutes or so, and repeat your experiments on recent Web data from the #openwebsearcheu Open Web Index.
-
I will be giving an invited talk at the #ECIR2026 IR4Good track about #OpenWebSearchEU: "Towards a shared infrastructure for assembling web search engines"
https://djoerdhiemstra.com/2026/towards-a-shared-infrastructure-for-assembling-web-search-engines/
-
I will be giving an invited talk at the #ECIR2026 IR4Good track about #OpenWebSearchEU: "Towards a shared infrastructure for assembling web search engines"
https://djoerdhiemstra.com/2026/towards-a-shared-infrastructure-for-assembling-web-search-engines/
-
Pour avoir une chance de devenir souverain @Qwant , @StartpageSearch , @ecosia et #OpenWebSearchEU devrait travailler ensemble.
#EuropeFirstUnitedSovereign #logicielLibre #technology #europe
-
Pour avoir une chance de devenir souverain @Qwant , @StartpageSearch , @ecosia et #OpenWebSearchEU devrait travailler ensemble.
#EuropeFirstUnitedSovereign #logicielLibre #technology #europe
-
#ECIR2026 notifications were friendly to me 🤗
1. Full paper "Open Web Indexes for Remote Querying" with @gijs and @djoerd.
Can we let ppl query the Terabytes of Web Index we collect in #OpenWebSearchEU in new ways, making good use of Parquet, S3, DuckDB?
Turns out the answer is a big YES!
Pre-print of the paper w/ code coming soon!
1/4
-
#ECIR2026 notifications were friendly to me 🤗
1. Full paper "Open Web Indexes for Remote Querying" with @gijs and @djoerd.
Can we let ppl query the Terabytes of Web Index we collect in #OpenWebSearchEU in new ways, making good use of Parquet, S3, DuckDB?
Turns out the answer is a big YES!
Pre-print of the paper w/ code coming soon!
1/4
-
#OpenWebSearchEU is a silver sponsor of #ECIR2025!
-
Open web index #OWI update:
4 billion URLs crawled
185 different languages
28 million Hosts
750 TB crawled
1 TB crawled per day
147 WARC Datasets
17.5 TB size of Open Web Index
28.8 TB size of WARC datasets
346 public datasets -
Open web index #OWI update:
4 billion URLs crawled
185 different languages
28 million Hosts
750 TB crawled
1 TB crawled per day
147 WARC Datasets
17.5 TB size of Open Web Index
28.8 TB size of WARC datasets
346 public datasets -
Today, Open Web Search consortium meeting at LRZ. #OpenWebSearchEU
-
@heinragas Thanks for offering! #OpenWebSearchEU provides the data and index. I hope there will be a fully functional search engine at the end of the project. (build by anyone!) @openwebsearcheu @Negin
-
-
This week: #OpenWebSearchEU consortium meeting in Nijmegen!
-
#OpenWebSearchEU has funding for organizations that build search engines using the open search infrastructure
https://openwebsearch.eu/third-party-calls-2024-media-release/
-
#OpenWebSearchEU has funding for organizations that build search engines using the open search infrastructure
https://openwebsearch.eu/third-party-calls-2024-media-release/
-
Frequently Asked Questions #FAQ about #OpenWebSearchEU
-
Another #ECIR2024 preprint online: "The Open Web Index: Crawling and Indexing the Web for Public Use". #OpenWebSearchEU
-
⭐️ OpenSearch #AdventCalendar | Day 19
ows.eu – Looking back & looking forwardAs the year is slowly coming to an end and we are ready to wind down a bit, it's time for a little year in review of our OpenWebSearch.eu project.
A quick reminder: We started the Horizon EU project in September 2022 with 13 other consortium partners.
Read about the year´s highlights in today´s advent calendar post:
https://opensearchfoundation.org/en/adventcalendar-2023/@openwebsearcheu
#OpenWebSearch #OpenWebSearchEU #OpenwebSearchCommunity -
Ethical, open and non-commercial: the Open Web Search project is designed to provide Europe with the right alternative to existing search engines
-
Ethical, open and non-commercial: the Open Web Search project is designed to provide Europe with the right alternative to existing search engines
-
Woke up at 6am to cycle through the pouring rain to the train station and miss my train by half a minute or so... Oh well.
On my way to the *Dutch-Belgian Information Retrieval workshop*, in Delft this year. Looking forward to spending the day with colleagues and getting updated on all the ongoing IR research "nearby".
https://dir2023.github.io/DIR2023/
In the afternoon, I stand in for @djoerd who unfortunately cannot make it (Covid 🙁), and will present the talk on #OpenWebSearchEU research project.
-
The first third-party funded project partners are on board!
They were selected from the first open call in spring and will enrich the #EU #horizonEurope project OpenWebSearch.eu with their expertise.
A warm welcome!More info: https://openwebsearch.eu/third-parties-onboarding
#OpenWebSearch #OpenWebSearchCommunity #OpenWebSearchEU #HorizonEurope
@EC_NGI -
Busy event week!
👉 #SC23 in Denver with #OpenWebSearchEU partners @LRZ_DE + IT4Innovations
👉 major panel on #OpenWebSearch + #LLMs at #NGIForum23 in Brussels , moderated by @osf's board member @frauplote and with OpenWebSearch.eu's principal investigator @grani of Universität Passau in the panel of experts. @alnuss explained the basic ows.eu ethics methodology at a workshop on #EthicsinSearch. Plus lots of good talks + interesting meetings with members of fellow @EC_NGI projects! -
🚀 #NGIForum23 has kicked off! For the next two days technologists, innovators + researchers will meet in Brussels to discuss the Next Generation Internet – an Internet of Trust for European Citizens + Businesses. Lots to talk about + lots to think about + plan!
#OpenWebSearchEU is represented by Stefan Voigt, @grani @alnuss, @frauplote and Megi (Maggie) Sharikadze, among others.
Also some representatives of our NGI "sister" projects are here on site. Good to meet you here in person!
-
Chorizo alarm for the weekend!
What does a slice of chorizo have to do with open #websearch? Dr. Tim Smith from #OpenWebSearchEU's project partner CERN shows the added value of an #OpenWebIndex for #internetsearch in his TED Talk "Navigating the Entangled Web" using examples from physics.
Highly recommended!⬇️ https://www.ted.com/talks/tim_smith_navigating_the_entangled_web
-
Chorizo alarm for the weekend!
What does a slice of chorizo have to do with open #websearch? Dr. Tim Smith from #OpenWebSearchEU's project partner CERN shows the added value of an #OpenWebIndex for #internetsearch in his TED Talk "Navigating the Entangled Web" using examples from physics.
Highly recommended!⬇️ https://www.ted.com/talks/tim_smith_navigating_the_entangled_web
-
Hello, live from the ows.eu consortium meeting in Ostrava! We are the #OpenWebSearchEU initiative, having joined forces to promote Europe’s independence in Web Search.
The goal: to develop an open European infrastructure for web search. Our initiative will be contributing to Europe’s digital sovereignty as well as promoting an open human-centered search engine market.Since today we are – finally – on Mastodon. Nice to be here!
-
Hello, live from the ows.eu consortium meeting in Ostrava! We are the #OpenWebSearchEU initiative, having joined forces to promote Europe’s independence in Web Search.
The goal: to develop an open European infrastructure for web search. Our initiative will be contributing to Europe’s digital sovereignty as well as promoting an open human-centered search engine market.Since today we are – finally – on Mastodon. Nice to be here!
-
Some incomplete list of publications that analyzed the #CommonCrawl data to identify malicious content are:
Srdjan Matic, et atl. Identifying sensitive URLs at web-scale, in Proceedings of the ACM Internet Measurement Conference, 2020, pp. 619–633.
https://gsmaragd.github.io/publications/IMC2020-GDPR/IMC2020-GDPR.pdf
-
Some incomplete list of publications that analyzed the #CommonCrawl data to identify malicious content are:
Srdjan Matic, et atl. Identifying sensitive URLs at web-scale, in Proceedings of the ACM Internet Measurement Conference, 2020, pp. 619–633.
https://gsmaragd.github.io/publications/IMC2020-GDPR/IMC2020-GDPR.pdf
-
#OWLer is the #OpenWebSearchEU collaborative web crawler. Do we crawl everything?
https://openwebsearcheu.pages.it4i.eu/wp1/owseu-crawler/owler/
-
#OWLer is the #OpenWebSearchEU collaborative web crawler
https://openwebsearcheu.pages.it4i.eu/wp1/owseu-crawler/owler/
-
❗ Even if search engines were completely neutral, the problem of human bias would remain.
👉 How can the influence of Confirmation Bias during web-search be identified through analyzing search behaviour of users?
At the Open Search Symposium #ossym23 Simon Hitzginger presented new research of a group of researchers of #TUGraz
Bottom line: Prediction of confirmation bias using search behaviour is possible. It could be used to inform users. But more data is needed.
-
👋 Meet #OWLer: Michael Dinzinger from University Passau's #OpenWebSearch team presented preliminary results on the collaborative #OpenWebCrawler at #ossym23
👉 In the last 4 weeks 1 single crawler of the OWLer family has fetched around 120m web documents, 93% of them successful fetches, said Michael Dinzlinger at #ossym23 Open Search Symposium.
Find more details here: https://openwebsearch.eu/owler/
-
👋 Meet #OWLer: Michael Dinzinger from University Passau's #OpenWebSearch team presented preliminary results on the collaborative #OpenWebCrawler at #ossym23
👉 In the last 4 weeks 1 single crawler of the OWLer family has fetched around 120m web documents, 93% of them successful fetches, said Michael Dinzlinger at #ossym23 Open Search Symposium.
Find more details here: https://openwebsearch.eu/owler/
-
When we submitted our JASIST position paper on the development of an open web index, reviewers complained that the term "gatekeeper" was ill-defined. Since yesterday, the EU made it utterly clear:
https://ec.europa.eu/commission/presscorner/detail/en/IP_23_4328
-
🎉 Our EU project OpenWebSearch.eu is turning 1 today! Happy birthday! May the next 2 years be just as successful + lead to an open, safe + transparent web search for all!
#ThankYou to our #OpenWebSearchEu project partners:
Universität Passau
@LRZ_DE
@Radboud_uni
Uni Leipzig
TU Graz
@DLR
IT4Innovations Supercomputing Center
CERN
CSC - IT Center for Science
A1 Slovenija d.d.
Bauhaus-Universität Weimar
#SUMA
#WebisGroup+ thank you to @[email protected]
-
I got this beautiful domain for building a #Frisian search engine using the #OpenWebSearchEU infrastructure. 😎
-
I got this beautiful domain for building a #Frisian search engine using the #OpenWebSearchEU infrastructure. 😎
-
We have a team page now at #OpenWebSearchEU!
-
New paper: "Impact and development of an Open Web Index for open web search"
#OpenWebSearchEU -
A walk with the sun in the middle of gray.
Listened to podcasts about search engines, web crawlers, indexing and ranking. Interested in #OpenWebSearch EU project. Anyone else? #HireMe
#nofilter #noedit #helsinki #finland #OpenWebIndex #OpenWebSearchEU
