#knowledgedistillation — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #knowledgedistillation, aggregated by home.social.
-
Knowledge Distillation of Black-Box Large Language Models
https://arxiv.org/abs/2401.07013
#HackerNews #KnowledgeDistillation #BlackBox #LLMs #AIResearch #MachineLearning #NLP
-
Published at #IRRJ: "Beyond Hostility: Detecting Subtle and Overt Forms of Online Conflict with Multi-Objective Learning" by Oliver Warke, Joemon M. Jose, and Jan Breitsohl. #Hostility, #OnlineConflictDetection, #SocialMedia, #BehaviourAnalysis, #KnowledgeDistillation, #Transformers, #NLP
-
Microsoft’s new OPCD technique trims system prompts dramatically while keeping LLM output quality intact. By compressing tokens and applying knowledge distillation, the model stays fast and accurate—great news for open‑source AI projects. Curious how they pull it off? Dive into the full benchmark analysis. #MicrosoftOPCD #LLMCompression #AIPerformance #KnowledgeDistillation
🔗 https://aidailypost.com/news/microsofts-opcd-cuts-system-prompts-while-preserving-ai-performance
-
DeepSeek R1 is revolutionizing AI with its cost-effective approach. By using specialist models and innovative training methods, it achieves high performance at a fraction of the cost. This challenges the traditional AI economics. More about this technology here:
https://dev.to/abhishek_gautam-01/a-slightly-technical-deep-dive-into-deepseek-r1-2023
#DeepSeek #AI #OpenSource #MachineLearning #ArtificialIntelligence #ReinforcementLearning #KnowledgeDistillation