home.social

#dwarkesh — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #dwarkesh, aggregated by home.social.

  1. AI’s slow (er than expected) take off…

    But the fundamental problem is that LLMs don’t get better over time the way a human would. The lack of continual learning is a huge huge problem. The LLM baseline at many tasks might be higher than an average human’s. But there’s no way to give a model high level feedback. You’re stuck with the abilities you get out of the box. You can keep messing around with the system prompt. In practice this just doesn’t produce anything even close to the kind of learning and improvement that human employees experience.

    The reason humans are so useful is not mainly their raw intelligence. It’s their ability to build up context, interrogate their own failures, and pick up small improvements and efficiencies as they practice a task.

    Why I have slightly longer timelines than some of my guests

    Dwarkesh of the eponymous podcast has a strong insight. This is related to the concept of ‘intelligence’ – which itself requires processing. The insight is that those associations build on itself versus a retraining which itself need not produce the same paths again. I need to mull more about the implications of this.

    #ai #dwarkesh #essay #learning #llm #podcast

  2. I watched the last episode of #Dwarkesh podcast. The guests was Dylan Patel from semianalysis.com — a big company that advise on semiconductors — and the creator of the Asianometry youtube channel, which is great for learning about #bigtech history, especially semiconductors.

    The most interesting part was about #Microsoft and #openAI is data centers and they plans to grow. I take some notes and add comments. Keep in mind, I didn’t double-check all the numbers, but Dylan is a expert.