home.social

#aitokenization — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #aitokenization, aggregated by home.social.

  1. Token prediction forces LLMs to drift. This piece shows why, what Zeno can teach us about it, and how fidelity-based auditing could finally keep models grounded hackernoon.com/zenos-paradox-a #aitokenization