• 3 Posts
  • 584 Comments
Joined 3 years ago
cake
Cake day: July 24th, 2023

help-circle





  • What do you think where this is going to end up? My personal assessment of the situation is that only the mega-corporations can afford enshittification like that, and even those are now getting a taste of their own medicine (Sloperators recreating their flagship products… it’s a race to the bottom with enshittification on one side and sloppy replacements on the other). Smaller sized companies will simply get buried when the quality of their products falls to garbage levels. This is what those smaller sized companies don’t realise yet: When everyone can churn out the same low quality slop, their USP and their customers are gone soon.


  • Let them, but insist they should also use Claude to QA their code and thus take responsibility for the whole thing. If they trust AI to be good enough, why not go full circle? That shouldn’t be a problem, right?

    Joking aside, I know there is a real danger of those people shifting the responsibility for their created code mess downwards to the developers and QA, and when shit inevitably hits the fan they know who to blame.


  • While that is partly true, it oversimplifies a few things. And these are the things that make LLMs a dead end for intelligence:

    • Evolution means constant learning and adaption. LLMs can’t be adapted on the go, they are stuck with their initial training data and retraining is a slow and externally controlled process. Apart from training, every additional information you give it while running must be loaded into the context, the space for context is limited and must be flushed before supplying different context. That’s a hard limit for evolution, at least with current technology.
    • The physical world is more important than you might think because everything hinges on this realm, including the electricity, cabling and hardware involved in running a model. The idea of an intelligent entity that exists purely as an ethereal cloud of logic unbound by physics is hard to justify, because the shape of logic itself is defined by the physical ground we are standing on. Therefore, an AI would need a first-hand access and understanding of the physical world to be successful. LLMs can’t have any of that, because they are purely language-bound.

    I personally think Yann LeCun (a pioneer of machine learning and AI) is on the right track with his research and his opinion that LLMs are a dead end for artificial intelligence. The reasons are more on a technical than a philosophical side.


  • Ghost pairing ist ein irreführender Begriff. “Digital incompetence” trifft es eher. Das potenzielle Opfer muss gleich mehrere dumme Dinge tun:

    • die eigene Telefonnummer in eine nicht vertrauenswürdige Website eingeben
    • einem Warnhinweis ignorieren und einfach auf “Ok” drücken ohne zu lesen oder zu verstehen was dort angezeigt wird

    Aber tatsächlich wäre es vermutlich sicherer wenn der Nutzer im Messenger initial selbst seine Paarungswilligkeit anzeigen müsste bevor eine solche Paarungsanfrage überhaupt möglich wird. So wie bei Bluetooth, wo die Auffindbarkeit explizit eingeschaltet werden muss und nur ein paar Minuten aktiv bleibt.



  • Not the OP, but any software developer who has spent some time with the inner workings of LLMs can tell you that. Open weight models are a good opportunity to explore how LLMs work on the inside and to experiment with them a lot more than you can do with the so called Frontier models. The technology however is the same. These are just very fancy statistical prediction machines, and the reason why you are so impressed with them is that the statistical average of what sounds reasonable in a conversation is exactly what people expect to hear on average, given a specific context. It’s a neat little trick that works only only as long as the context fits (contentwise and spacewise), and once you realize that you’ll see LLMs as what they truly are. There is no magic, and the “intelligence” is the intelligence of the people who built those systems, the systems themselves are not intelligent in any commonly used sense of the word.