home.social

#trectot — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #trectot, aggregated by home.social.

fetched live
  1. ⏰ Gentle reminder: The run submission deadline for TREC 2025 Tip-of-the-Tongue (ToT) Track is end-of-day this **Wednesday (Sep 10)** Anywhere-on-Earth (AoE) time zone. Please make sure to submit your runs before the deadline.

    Guidelines: trec-tot.github.io/guidelines
    #TREC2025 #TRECToT #TREC2025ToT

  2. Hello TREC-ToTers! 👋🏽

    📆 Good news! We are extending the run submission deadline by 2 weeks. Please submit your runs by **September 10 (Wednesday)** and spread the word.

    More info: trec-tot.github.io/guidelines
    #TREC2025 #TRECToT #TREC2025ToT

  3. Gentle reminder 📢
    All run submissions for the Tip-of-the-Tongue (ToT) Track are due next week Wednesday (Aug 27).

    More info: trec-tot.github.io/guidelines
    #TREC2025 #TRECToT #TREC2025ToT

  4. Important announcement: All run submissions for the TREC'25 Tip-of-the-Tongue (TREC-ToT) Track are due by **August 27th**.

    The run submission form is now open. Please submit your runs before the deadline.

    More information: trec-tot.github.io/guidelines
    #TREC2025 #TRECToT #TREC2025ToT

    Please spread the word!

  5. Hello TREC-ToTers!

    We have released the test queries for the TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track. Please see the guidelines for more information: trec-tot.github.io/guidelines. Run submission deadline will tentatively be in August. #TREC2025 #TRECToT #TREC2025ToT

    Please spread the word!

  6. Hello TREC-ToTers! 👋🏽

    Excited to announce the release of TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track guidelines: trec-tot.github.io/guidelines. We will release test queries in July and run submission deadline will be in August. #TREC2025 #TRECToT #TREC2025ToT

    Please register to participate:

  7. *IMPORTANT ANNOUNCEMENT*
    We are extending the #TREC Tip-of-the-Tongue (ToT) Track run submission deadline to October 4th (**10 days from today**).

    Registration and submission details can be found in the track guidelines: trec-tot.github.io/guidelines

    #TREC2024 #TRECToT #TREC2024ToT

  8. Dear TREC-ToTers, less than two weeks to go! #TREC2024 #TRECToT #TREC2024ToT
    👉🏽 Run submission deadline: **September 23rd**
    👉🏽 Submission form: ir.nist.gov/evalbase/conf/trec
    👉🏽 Guidelines: trec-tot.github.io/guidelines
    👉🏽 You need to register to participate: trec-tot.github.io/guidelines#

  9. We have released the test queries for TREC 2024 Tip-of-the-Tongue Track! #TRECToT #TREC2024ToT

    🟢 Guidelines: trec-tot.github.io/guidelines
    🟢 Run submission deadline: September 23rd

    Let's gooooooo!

  10. Hello TREC-TOTers!

    Gentle reminders for #TREC2024 ToT Track:
    🟢 Guidelines + train/dev data already available @ trec-tot.github.io/guidelines
    🟢 Test queries will be released later this month
    🟢 Submission deadline will be in September

    Watch this space for more announcements! #TRECToT

  11. 🟡 Announcing the release of TREC 2024 Tip-of-the-Tongue (TREC-ToT) Track guidelines: trec-tot.github.io/guidelines. This year we have three domains: Movies, Landmarks, and Celebrities. We will release test queries in August and run submission deadline will be in September. #TREC #TREC2024 #TRECToT #TREC2024ToT

    Please register to participate: trec-tot.github.io/guidelines#

  12. #TREC2023ToT is now accepting runs. Please submit your runs soon! #TRECToT #TREC2023

    📄 Guidelines: trec-tot.github.io/guidelines
    🏃🏽‍♀️ Run submission form: ir.nist.gov/trecsubmit/tot.htm
    ⏰ Run submission deadline: Aug 31

  13. #TREC2023ToT is now accepting runs. Please submit your runs soon! #TRECToT #TREC2023

    📄 Guidelines: trec-tot.github.io/guidelines
    🏃🏽‍♀️ Run submission form: ir.nist.gov/trecsubmit/tot.htm
    ⏰ Run submission deadline: Aug 31

  14. We have released the test queries for TREC 2023 Tip-of-the-Tongue Track! #TRECToT #TREC2023ToT

    📄 Guidelines: trec-tot.github.io/guidelines
    ⏰ Run submission deadline: Aug 31

    Here we gooooooo!

  15. We got GPT4 baseline for #TREC2023ToT Track! 🙌🏽 Test queries will be released on July 24 and run submission deadline is Aug 31.

    Get your runs ready, should be an exciting #TRECToT track this year! 😎

    Guidelines and more info: trec-tot.github.io/guidelines

  16. #TRECToT updates:

    📰 News: GPT4 baseline run significantly improves DCG over BM25 and dense retrieval. What approaches will you try at the track this year?

    ⏰ Reminder: Test queries will be released on July 24. Run submission deadline is Aug 31.

    Guidelines: trec-tot.github.io/guidelines

    #TREC2023ToT

  17. ⏰Gentle reminder: We'll release the TREC 2023 Tip-of-the-Tongue test queries in just over 2 weeks. We are super excited and looking forward to seeing all the creative approaches participants employ for this year's track. #TREC2023ToT #TRECToT

    More info: trec-tot.github.io

  18. From @bmitra

    #TRECToT update: We have baselines!

    We’re releasing 2 baselines using BM25 & dense retrieval that participants can compare against and build on. As these early results show, there's a lot of room to improve on this task!

    Check guidelines for more details: trec-tot.github.io/guidelines

  19. We've got BASELINES for our #TREC2023ToT Track! Lots of room to improve, should be an exciting track this year! 🙌🏽 #TRECToT

    mastodon.social/@TREC_ToT@idf.

  20. #TRECToT update: We have baselines!

    We’re releasing 2 baselines using BM25 & dense retrieval that participants can compare against and build on. As these early results show, there's a lot of room to improve on this task!

    Check guidelines for more details: trec-tot.github.io/guidelines

  21. Hello!👋🏽

    Quick #TRECToT updates:

    📰 We added Wikipedia-IMDB mappings to our datasets: trec-tot.github.io/guidelines.
    📣 Release date for test queries: July 24.
    👥 Please join groups.google.com/g/trec_tot for latest news. Registered participants make sure you're on trectalk.slack.com.

  22. I'm co-organizing 2 TREC tracks this year: Tip-of-the-Tongue & Deep Learning. Excited that 20+ groups have already registered for each. 🙌🏽#TREC2023

    Please Register: ir.nist.gov/trecsubmit.open/ap

    * TREC-ToT Track: Test queries to be released in July. Submission deadline: August 31st. #TRECToT #TREC2023ToT
    Guidelines: trec-tot.github.io

    * TREC-DL Track: Test queries to be released in June. Submission deadline: July 31st. #TRECDL #TREC2023DL
    Guidelines: microsoft.github.io/msmarco/TR

  23. 🚨 Announcement 🚨
    TREC 2023 Tip-of-the-Tongue (TREC-ToT) Track guidelines are now online: trec-tot.github.io. Test queries will be released in July and August 31st is the submission deadline. #TRECToT #TREC2023ToT

    To participate, please pre-register: ir.nist.gov/trecsubmit.open/ap.

  24. Super excited about #TREC'23! 🙌🏽 This year is the 5th anniversary 🎂 of the Deep Learning Track. #TRECDL I'm also co-organizing the Tip-of-the-Tongue Track, #TRECToT the cool new track 😎 at TREC w/ complex and ambiguous information needs. Please participate!
    trec.nist.gov/pubs/call2023.ht

    idf.social/@TREC_ToT/109914661

  25. #Introductions 👋🏽

    Have you ever tried re-finding a movie you watched as a child but can't remember its name? Perhaps you vaguely remember the plot or a few scenes or the context in which you watched it.

    We are hosting The Tip-of-the-Tongue (ToT) Track at #TREC, a shared task focusing on known-item identification where the searcher can't recall a reliable identifier ("It’s on the tip of my tongue…").

    Follow us for announcements and updates, and don't forget to participate in the track! #TRECToT

  26. Announcing brand new track for #TREC2023📣
    (Please boost)

    We hope Tip-of-the-Tongue (ToT) Track will be an interesting & fun IR task going beyond simple keyword-based searches with opportunities for both traditional and LLM-based approaches. #TRECToT #TREC2023ToT

    If you have any questions, please reach out to me or one of my track co-organizers.

    Also, if you are at #TREC2022 please drop by our poster & join the track planning session this Friday to learn more & provide feedback!

    More details👇🏽