#modelrecyclying — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #modelrecyclying, aggregated by home.social.
-
We want to pretrain🤞
Instead we finetune🚮😔
Could we collaborate?🤗ColD Fusion:
🔄Recycle finetuning to multitask
➡️evolve pretrained models foreverOn 35 datasets
+2% improvement over RoBERTa
+7% in few shot settings
🧵#NLProc #MachinLearning #NLP #ML #modelRecyclying #collaborativeAI #scientivism #pretrain
-
We want to pretrain🤞
Instead we finetune🚮😔
Could we collaborate?🤗ColD Fusion:
🔄Recycle finetuning to multitask
➡️evolve pretrained models foreverOn 35 datasets
+2% improvement over RoBERTa
+7% in few shot settings
🧵