New Theory Suggests Chatbots Can Understand Text | Quanta Magazine
www.quantamagazine.org
Far from being “stochastic parrots,” the biggest large language models seem to learn enough skills to understand the words they’re processing.

I’ve been saying this for about a year, since seeing the Othello GPT research, but it’s great to see more minds changing on the subject.

  • beetus@lemmy.world
    2·
    10 months ago

    Neat to see, but I don’t buy it yet. I think their assumptions are reasonable but without verifying the training data or working directly with these LLM firms on these studies, I don’t see how they can claim it’s producing novel non-trained output.

    Regardless, it’s a step in the right direction for us better understanding the seemingly black box we created.