#vaswani — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #vaswani, aggregated by home.social.
-
I read #Rumelhart's #backpropagation paper in 1986. It was a stunner. It changed my life.
http://www.cs.utoronto.ca/~hinton/absps/naturebp.pdf
And I read #Vaswani's #transformer in 2017. It was a groundbreaking paper. It changed the world.
It could be argued that transformers, through their use in #LLMs, have had far greater impact upon society, compared to backpropagation. On the other hand, there would be no modern #ML, but for backpropagation. So, it's a toss-up.
But to me, Rumelhart's paper is superior to Vaswani's, at least in terms of clarity, concision, coherence, and other indicia of writing style.
-
I read #Rumelhart's #backpropagation paper in 1986. It was a stunner. It changed my life.
http://www.cs.utoronto.ca/~hinton/absps/naturebp.pdf
And I read #Vaswani's #transformer in 2017. It was a groundbreaking paper. It changed the world.
It could be argued that transformers, through their use in #LLMs, have had far greater impact upon society, compared to backpropagation. On the other hand, there would be no modern #ML, but for backpropagation. So, it's a toss-up.
But to me, Rumelhart's paper is superior to Vaswani's, at least in terms of clarity, concision, coherence, and other indicia of writing style.