home.social

#openwebsearcheu — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #openwebsearcheu, aggregated by home.social.

fetched live
  1. Gijs Hendriksen presenting our work on "remote querying" to provide access to huge Web resources through de facto standard tech: Parquet files in S3 queried using #DuckDB to facilitate IR research at very acceptable latencies.

    Run your ClueWeb experiment in 10 minutes or so, and repeat your experiments on recent Web data from the #openwebsearcheu Open Web Index.

  2. Gijs Hendriksen presenting our work on "remote querying" to provide access to huge Web resources through de facto standard tech: Parquet files in S3 queried using #DuckDB to facilitate IR research at very acceptable latencies.

    Run your ClueWeb experiment in 10 minutes or so, and repeat your experiments on recent Web data from the #openwebsearcheu Open Web Index.

  3. #ECIR2026 notifications were friendly to me 🤗

    1. Full paper "Open Web Indexes for Remote Querying" with @gijs and @djoerd.

    Can we let ppl query the Terabytes of Web Index we collect in #OpenWebSearchEU in new ways, making good use of Parquet, S3, DuckDB?

    Turns out the answer is a big YES!

    Pre-print of the paper w/ code coming soon!

    1/4

  4. #ECIR2026 notifications were friendly to me 🤗

    1. Full paper "Open Web Indexes for Remote Querying" with @gijs and @djoerd.

    Can we let ppl query the Terabytes of Web Index we collect in #OpenWebSearchEU in new ways, making good use of Parquet, S3, DuckDB?

    Turns out the answer is a big YES!

    Pre-print of the paper w/ code coming soon!

    1/4

  5. Open web index #OWI update:

    4 billion URLs crawled
    185 different languages
    28 million Hosts
    750 TB crawled
    1 TB crawled per day
    147 WARC Datasets
    17.5 TB size of Open Web Index
    28.8 TB size of WARC datasets
    346 public datasets

    #OpenWebSearchEU #OpenWebSearch

    ows.eu

  6. Open web index #OWI update:

    4 billion URLs crawled
    185 different languages
    28 million Hosts
    750 TB crawled
    1 TB crawled per day
    147 WARC Datasets
    17.5 TB size of Open Web Index
    28.8 TB size of WARC datasets
    346 public datasets

    #OpenWebSearchEU #OpenWebSearch

    ows.eu

  7. @heinragas Thanks for offering! #OpenWebSearchEU provides the data and index. I hope there will be a fully functional search engine at the end of the project. (build by anyone!) @openwebsearcheu @Negin

  8. ⭐️ OpenSearch #AdventCalendar | Day 19
    ows.eu – Looking back & looking forward

    As the year is slowly coming to an end and we are ready to wind down a bit, it's time for a little year in review of our OpenWebSearch.eu project.

    A quick reminder: We started the Horizon EU project in September 2022 with 13 other consortium partners.

    Read about the year´s highlights in today´s advent calendar post:
    opensearchfoundation.org/en/ad

    @openwebsearcheu
    #OpenWebSearch #OpenWebSearchEU #OpenwebSearchCommunity

  9. Ethical, open and non-commercial: the Open Web Search project is designed to provide Europe with the right alternative to existing search engines

    home.cern/news/news/computing/

    #OpenWebSearchEU

  10. Ethical, open and non-commercial: the Open Web Search project is designed to provide Europe with the right alternative to existing search engines

    home.cern/news/news/computing/

    #OpenWebSearchEU

  11. Woke up at 6am to cycle through the pouring rain to the train station and miss my train by half a minute or so... Oh well.

    On my way to the *Dutch-Belgian Information Retrieval workshop*, in Delft this year. Looking forward to spending the day with colleagues and getting updated on all the ongoing IR research "nearby".

    dir2023.github.io/DIR2023/

    In the afternoon, I stand in for @djoerd who unfortunately cannot make it (Covid 🙁), and will present the talk on #OpenWebSearchEU research project.

  12. The first third-party funded project partners are on board!
    They were selected from the first open call in spring and will enrich the #EU #horizonEurope project OpenWebSearch.eu with their expertise.
    A warm welcome!

    More info: openwebsearch.eu/third-parties

    #OpenWebSearch #OpenWebSearchCommunity #OpenWebSearchEU #HorizonEurope
    @EC_NGI

  13. Busy event week!
    👉 #SC23 in Denver with #OpenWebSearchEU partners @LRZ_DE + IT4Innovations
    👉 major panel on #OpenWebSearch + #LLMs at #NGIForum23 in Brussels , moderated by @osf's board member @frauplote and with OpenWebSearch.eu's principal investigator @grani of Universität Passau in the panel of experts. @alnuss explained the basic ows.eu ethics methodology at a workshop on #EthicsinSearch. Plus lots of good talks + interesting meetings with members of fellow @EC_NGI projects!

  14. 🚀 #NGIForum23 has kicked off! For the next two days technologists, innovators + researchers will meet in Brussels to discuss the Next Generation Internet – an Internet of Trust for European Citizens + Businesses. Lots to talk about + lots to think about + plan!

    #OpenWebSearchEU is represented by Stefan Voigt, @grani @alnuss, @frauplote and Megi (Maggie) Sharikadze, among others.

    Also some representatives of our NGI "sister" projects are here on site. Good to meet you here in person!

  15. Chorizo alarm for the weekend!
    What does a slice of chorizo have to do with open #websearch? Dr. Tim Smith from #OpenWebSearchEU's project partner CERN shows the added value of an #OpenWebIndex for #internetsearch in his TED Talk "Navigating the Entangled Web" using examples from physics.
    Highly recommended!

    ⬇️ ted.com/talks/tim_smith_naviga

  16. Chorizo alarm for the weekend!
    What does a slice of chorizo have to do with open #websearch? Dr. Tim Smith from #OpenWebSearchEU's project partner CERN shows the added value of an #OpenWebIndex for #internetsearch in his TED Talk "Navigating the Entangled Web" using examples from physics.
    Highly recommended!

    ⬇️ ted.com/talks/tim_smith_naviga

  17. Hello, live from the ows.eu consortium meeting in Ostrava! We are the #OpenWebSearchEU initiative, having joined forces to promote Europe’s independence in Web Search.
    The goal: to develop an open European infrastructure for web search. Our initiative will be contributing to Europe’s digital sovereignty as well as promoting an open human-centered search engine market.

    Since today we are – finally – on Mastodon. Nice to be here!

    #neuhier #newhere

  18. Hello, live from the ows.eu consortium meeting in Ostrava! We are the #OpenWebSearchEU initiative, having joined forces to promote Europe’s independence in Web Search.
    The goal: to develop an open European infrastructure for web search. Our initiative will be contributing to Europe’s digital sovereignty as well as promoting an open human-centered search engine market.

    Since today we are – finally – on Mastodon. Nice to be here!

    #neuhier #newhere

  19. Some incomplete list of publications that analyzed the #CommonCrawl data to identify malicious content are:

    Srdjan Matic, et atl. Identifying sensitive URLs at web-scale, in Proceedings of the ACM Internet Measurement Conference, 2020, pp. 619–633.

    gsmaragd.github.io/publication

    #OpenWebSearchEU

  20. Some incomplete list of publications that analyzed the #CommonCrawl data to identify malicious content are:

    Srdjan Matic, et atl. Identifying sensitive URLs at web-scale, in Proceedings of the ACM Internet Measurement Conference, 2020, pp. 619–633.

    gsmaragd.github.io/publication

    #OpenWebSearchEU

  21. ❗ Even if search engines were completely neutral, the problem of human bias would remain.

    👉 How can the influence of Confirmation Bias during web-search be identified through analyzing search behaviour of users?

    At the Open Search Symposium #ossym23 Simon Hitzginger presented new research of a group of researchers of #TUGraz

    Bottom line: Prediction of confirmation bias using search behaviour is possible. It could be used to inform users. But more data is needed.

    #OpenWebSearchEU @EC_NGI

  22. 👋 Meet #OWLer: Michael Dinzinger from University Passau's #OpenWebSearch team presented preliminary results on the collaborative #OpenWebCrawler at #ossym23

    👉 In the last 4 weeks 1 single crawler of the OWLer family has fetched around 120m web documents, 93% of them successful fetches, said Michael Dinzlinger at #ossym23 Open Search Symposium.

    Find more details here: openwebsearch.eu/owler/

    #OpenWebSearchEU @[email protected]

  23. 👋 Meet #OWLer: Michael Dinzinger from University Passau's #OpenWebSearch team presented preliminary results on the collaborative #OpenWebCrawler at #ossym23

    👉 In the last 4 weeks 1 single crawler of the OWLer family has fetched around 120m web documents, 93% of them successful fetches, said Michael Dinzlinger at #ossym23 Open Search Symposium.

    Find more details here: openwebsearch.eu/owler/

    #OpenWebSearchEU @[email protected]

  24. When we submitted our JASIST position paper on the development of an open web index, reviewers complained that the term "gatekeeper" was ill-defined. Since yesterday, the EU made it utterly clear:

    ec.europa.eu/commission/pressc

    #OpenWebSearchEU

  25. 🎉 Our EU project OpenWebSearch.eu is turning 1 today! Happy birthday! May the next 2 years be just as successful + lead to an open, safe + transparent web search for all!

    #ThankYou to our #OpenWebSearchEu project partners:
    Universität Passau
    @LRZ_DE
    @Radboud_uni
    Uni Leipzig
    TU Graz
    @DLR
    IT4Innovations Supercomputing Center
    CERN
    CSC - IT Center for Science
    A1 Slovenija d.d.
    Bauhaus-Universität Weimar
    #SUMA
    #WebisGroup

    + thank you to @[email protected]

    #OpenSearchEurope #HorizonEurope

  26. I got this beautiful domain for building a #Frisian search engine using the #OpenWebSearchEU infrastructure. 😎

    sykje.frl

  27. I got this beautiful domain for building a #Frisian search engine using the #OpenWebSearchEU infrastructure. 😎

    sykje.frl

  28. A walk with the sun in the middle of gray.

    Listened to podcasts about search engines, web crawlers, indexing and ranking. Interested in #OpenWebSearch EU project. Anyone else? #HireMe

    #nofilter #noedit #helsinki #finland #OpenWebIndex #OpenWebSearchEU