home.social

#cscs — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #cscs, aggregated by home.social.

  1. New blog post from the first two #SNAI #SMECircle meetings, highlighting practical applications, encouraging discussion around tools like #Apertus & public infrastructure like #CSCS #Alps - with a focus on responsible and sustainable use: log.alets.ch/115/

  2. In response to my question on #openhardware and alternatives to CUDA, he hopes that #OpenCL will rise to the challenge of demanding 64-bit+ models rather than the current focus on 4-bit quantized builds that are insufficient for HPC science.

    See also my notes and links on MLP like #Apertus at #CSCS at swissai.dribdat.cc/project/14

  3. How much power does 3 month of training #Apertus on the most powerful open research cloud-native supercomputer in Europe?

    ⚡️About the same as raising 5 people to adulthood, or 50% peak (10MW) of a locomotive. Keep industrial power usage in perspective, and acknowledge the efforts into climate neutrality, asks Joost VandeVondele - who aims to scale up the infrastructure to support thousands of AI experiments and hundreds of SMEs in the future at #CSCS

  4. #Switzerland launches transparent #ChatGPT alternative
    #Apertus: A fully #opensource, transparent, multilingual language model
    The Apertus #LLM is comparable to Meta’s #Llama3 model from 2024
    The development of the #largelanguagemodel (#LLM) and the research into other domain-specific foundation models is funded by an investment of over 10 million GPU hours on the “#Alps#Supercomputer by #CSCS, and by the ETH Board
    cscs.ch/science/computer-scien

  5. Meet #Apertus a #LLM from #Switzerland developed by #EPFL, #ETH and #CSCS. It's fully #opensource and trained in #alps

    Here some facts about it:
    * trained with 15 trillion tokens
    * 1'000 languages supported
    * maximum 70 billion parameters
    * Trained on 4'096 GPU's for over 3 months
    * Trained by respecting Swiss data protection laws, Swiss copyright laws, and the transparency obligations under the EU AI Act

    I will definitely give it a try.

    For more informations:

    swiss-ai.org/apertus

  6. I recently visited the Swiss National Supercomputing Centre ( )in Lugano.

    Now and have publicly announced that they are training an on "Alps" supercomputing. The best part is that they are doing it

    "Alps" will compute at 0.435 * 10^18 FLOPS. This means that "Alps" can calculate more in one day than a modern laptop in 2025 could calculate in 40,000 years. Amazing!

    ethz.ch/en/news-and-events/eth

  7. #ETH Zurich & #EPFL (w/ #CSCS) will drop a fully open large-language model trained on the “Alps” supercomputer. Built from scratch on public infrastructure, fluent in 1000 + languages, Apache-2 licensed. Landing late-summer 2025

    > A language model built for the public good

    ethz.ch/en/news-and-events/eth

    #OpenSource #LLM #AIForGood #ai #llms #switzerland

  8. @isazi right, thanks, I am just curious who currently uses them.
    E.g. I work with #CSCS in #Lugano and major notable customers are #meteosuisse , #WLCG (#particlephysics). I specifically work for #CTA and #SKA astronomical observatories, but their use is not yet substantial.

    There any many others too, I am not totally sure about relative use. E.g. #climate modelling is of course a very interesting case

    Or is it a large number of small customers?

  9. 其他社群貼文轉貼-21,不錯的貼文我會轉貼,方便無法訪問相關網站的朋友取得資訊:

    開放文化基金會 OCF 實習夥伴募集!新學期熱烈再開!!想認識什麼是自由與開放的科技嗎?
    想知道開放原始碼的工具在各個領域是如何被應用的嗎?
    想了解開放資料與開放政府現在的發展狀況嗎?
    想體驗在 NGO 工作的情況嗎?以上這些,在 OCF 實習通通可以做到!
    趕快來填表格,體驗這次難得的實習機會!
    blog.ocf.tw/2022/06/2022.html

    同時,我們也和各個開源社群合作,想參與 RubyTW, CSCS, FreeBSD, CNTUG 這些社群的實習計畫,也歡迎查看相關資訊喔!

    #CNTUG blog.ocf.tw/2022/08/2022-cntug
    #FreeBSD blog.ocf.tw/2022/06/2022-freeb
    #RubyTW blog.ocf.tw/2022/04/2022-rubyt
    #CSCS blog.ocf.tw/2022/05/2022-cscs.

    #OCF #NGO #開放文化基金會 #實習 #社群
    #facebook #轉貼 #臉書
    #台灣Vtuber #Vtubers #Taiwan