home.social

#mixture — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #mixture, aggregated by home.social.

fetched live
  1. 📡 New post:

    The twenty five brain architecture inside Mickai, and why it is structurally not a Mixture of Experts. SENTINEL, CORTEX, HIPPOCAMPUS, AMYGDALA, and twenty one specialists, each in its own process, with its own queue, signing its own audit.

    Readers familiar with the Mixture of Experts literature sometimes assume Mickai

    mickai.co.uk/articles/the-twen

    #mickai #multi-brain #architecture #mixture-of-experts #moe

  2. 📡 New post:

    The twenty five brain architecture inside Mickai, and why it is structurally not a Mixture of Experts. SENTINEL, CORTEX, HIPPOCAMPUS, AMYGDALA, and twenty one specialists, each in its own process, with its own queue, signing its own audit.

    Readers familiar with the Mixture of Experts literature sometimes assume Mickai

    mickai.co.uk/articles/the-twen

    #mickai #multi-brain #architecture #mixture-of-experts #moe

  3. [Перевод] Вышел DeepSeek V4. Почему это очень плохо для США? DeepSeek V4 Pro — это 1,6 триллиона параметров, mixture of experts (MoE), ...

    #DeepSeek #V4 #mixture #of #experts #open #source #LLM #frontier #модели #SWE-bench

    Origin | Interest | Match
  4. Why NVLink Is Nvidia’s Secret Sauce Driving a 10x Performance Boost in MoEs We’ve seen a significant metamorphosis occur in AI in the past year, thanks to the emergence of large, capable Mixtur...

    #Features #AI #for #Science #DeepSeek-R1 #extreme #co-design #HPC #Ian #Buck #mixture

    Origin | Interest | Match
  5. <li><a href="#mixture-of-models-vs-mixture-of-experts">Mixture-of-Models vs Mixture-of-Experts</a></li>
    <li><a href="#the-mom-design-philosophy">The MoM Design Philosophy</a></li>
    <li><a href="#live-demo-on-amd-gpus">Live Demo on AMD GPUs</a></li>
    <li><a href="#signal-based-routing">Signal-Based Routing</a></li>
    <li><a href="#deploy-your-own">Deploy Your Own</a></li>
    </ul>

    <hr />

    <h2 id="mixture-of-models-vs-mixture-of-experts">Mixture-of-Models vs Mixture-of-Experts</h2>

  6. <li><a href="#mixture-of-models-vs-mixture-of-experts">Mixture-of-Models vs Mixture-of-Experts</a></li>
    <li><a href="#the-mom-design-philosophy">The MoM Design Philosophy</a></li>
    <li><a href="#live-demo-on-amd-gpus">Live Demo on AMD GPUs</a></li>
    <li><a href="#signal-based-routing">Signal-Based Routing</a></li>
    <li><a href="#deploy-your-own">Deploy Your Own</a></li>
    </ul>

    <hr />

    <h2 id="mixture-of-models-vs-mixture-of-experts">Mixture-of-Models vs Mixture-of-Experts</h2>

  7. Mixture-of-Experts: архитектура, которая спасает LLM от их собственного аппетита Долгое время большие языковые модел...

    #mixture #of #experts #MoE #архитектура #плотные #разреженные #модели #проблемы #MoE

    Origin | Interest | Match
  8. Mixture-of-Experts: архитектура, которая спасает LLM от их собственного аппетита Долгое время большие языковые модел...

    #mixture #of #experts #MoE #архитектура #плотные #разреженные #модели #проблемы #MoE

    Origin | Interest | Match
  9. #medieval #mixture
    Aujourd'hui malgré le temps bof, je fabrique des "potées" pour le #mélange du foyer de ma #forge portable (ça s'appelle la #brasque), #argile du jardin, #chamotte, paille, sable, charbon de bois pilé.

    Today, despite the poor weather, I'm making "mixture" for the forge hearth mix of my #portable #forge (it's called the #brasque), #clay from the garden, #chamotte, straw, sand, pounded charcoal.

  10. 'Gaussian Mixture Models with Rare Events', by Xuetong Li, Jing Zhou, Hansheng Wang.

    jmlr.org/papers/v25/23-1245.ht

    #mixture #gaussian #empirical

  11. 'Gaussian Mixture Models with Rare Events', by Xuetong Li, Jing Zhou, Hansheng Wang.

    jmlr.org/papers/v25/23-1245.ht

    #mixture #gaussian #empirical

  12. 'Flexible Bayesian Product Mixture Models for Vector Autoregressions', by Suprateek Kundu, Joshua Lukemire.

    jmlr.org/papers/v25/22-0717.ht

    #mixture #multivariate #mixtures

  13. 'Flexible Bayesian Product Mixture Models for Vector Autoregressions', by Suprateek Kundu, Joshua Lukemire.

    jmlr.org/papers/v25/22-0717.ht

    #mixture #multivariate #mixtures

  14. Whatever happened to the awesome “Moto Mixture” in Adyar Anand Bhavan (A2B), #Bangalore? 😧

    Haven’t been able to find it on Swiggy or Zomato for *months* now. 😢

    It’s second only to the “Madras Mixture” from Grand Sweets, #Chennai. 🤤

    #A2B #Savories #Mixture #MotoMixture

  15. Whatever happened to the awesome “Moto Mixture” in Adyar Anand Bhavan (A2B), #Bangalore? 😧

    Haven’t been able to find it on Swiggy or Zomato for *months* now. 😢

    It’s second only to the “Madras Mixture” from Grand Sweets, #Chennai. 🤤

    #A2B #Savories #Mixture #MotoMixture

  16. #Mixture, una aventura de acción y fantasía para PlayStation VR2, llegará en formato físico. Controla a Sephairos y Sola, explora tierras baldías, derrota a jefes gigantes y busca la redención. Disponible para reservar, lanzamiento el 8 de marzo de 2024. #PlayStationVR2 #MeridiemGames

  17. A Unified Perspective on Natural Gradient Variational Inference with Gaussian Mixture Models

    Oleg Arenz, Philipp Dahlinger, Zihan Ye, Michael Volpp, Gerhard Neumann

    Action editor: George Papamakarios.

    openreview.net/forum?id=tLBjsX

    #variational #mixture #gradient

  18. A Unified Perspective on Natural Gradient Variational Inference with Gaussian Mixture Models

    Oleg Arenz, Philipp Dahlinger, Zihan Ye, Michael Volpp, Gerhard Neumann

    Action editor: George Papamakarios.

    openreview.net/forum?id=tLBjsX

    #variational #mixture #gradient

  19. 'Consistent Model-based Clustering using the Quasi-Bernoulli Stick-breaking Process', by Cheng Zeng, Jeffrey W Miller, Leo L Duan.

    jmlr.org/papers/v24/22-0436.ht

    #clusters #clustering #mixture

  20. 'Consistent Model-based Clustering using the Quasi-Bernoulli Stick-breaking Process', by Cheng Zeng, Jeffrey W Miller, Leo L Duan.

    jmlr.org/papers/v24/22-0436.ht

    #clusters #clustering #mixture

  21. Hey hey, new #Mixture #newsletter just dropped! It's VERY #pink this week, but as a result of a story related to that colour I'm actually trying to have a serious discussion about factual reporting and #science #writing so don't be fooled. mixture.substack.com/p/factual

  22. Hey hey, new #Mixture #newsletter just dropped! It's VERY #pink this week, but as a result of a story related to that colour I'm actually trying to have a serious discussion about factual reporting and #science #writing so don't be fooled. mixture.substack.com/p/factual

  23. New #Mixture is out! In which I share the story of how I dropped out of gymnastics because it clashed with my high school physics class. mixture.substack.com/p/science

  24. New #Mixture is out! In which I share the story of how I dropped out of gymnastics because it clashed with my high school physics class. mixture.substack.com/p/science

  25. 'Regularized Joint Mixture Models', by Konstantinos Perrakis, Thomas Lartigue, Frank Dondelinger, Sach Mukherjee.

    jmlr.org/papers/v24/21-0796.ht

    #sparse #regularized #mixture

  26. 'Regularized Joint Mixture Models', by Konstantinos Perrakis, Thomas Lartigue, Frank Dondelinger, Sach Mukherjee.

    jmlr.org/papers/v24/21-0796.ht

    #sparse #regularized #mixture