#recursivepollution — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #recursivepollution, aggregated by home.social.
-
NEW BIML Bibliography entry
https://arxiv.org/abs/2503.03150
Position: Model Collapse Does Not Mean What You Think
Rylan Schaeffer, Joshua Kazdan, Alvan Caleb Arulandu, Sanmi Koyejo
We think recursive pollution is a better term than model collapse. Weak terminology leads to misunderstanding of impact. See figure 4. This is a very good paper.
-
NEW BIML Bibliography entry
https://arxiv.org/abs/2404.05090
How Bad is Training on Synthetic Data? A Statistical Analysis of Language Model Collapse
Mohamed El Amine Seddik, et al
This treatment fails because the models being studied are TOY models too simple to be interesting.