Sam Altman:

A lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we’re going to be able to run them on our computers, and so we’re not going to need all the stuff in the data center.

But from a global allocation perspective, actually it’s quite terrible to have everybody, like, have a bunch of the world’s limited supply of DRAM sitting in their own computer and being used five percent of the time.

Like you want maximum utilisation in the cloud if you’re trying to deal with this very supply-constrained environment,

And somehow many people’s intuition is the opposite of that

TL;DR Guy selling product: “Here’s why owning your own product instead of renting it from me is a terrible idea”

  • PerogiBoi@lemmy.ca
    link
    fedilink
    English
    arrow-up
    7
    ·
    9 hours ago

    Sam Altman is an example of a terrible allocation of resources. Think of how much oxygen and dihydrogen monoxide he consumes? And for what? He just needlessly produces carbon dioxide in record amounts. The elementary particles that make up the sack of biotic matter that calls itself Samuel would be better suited for other applications. Agriculture comes to mind.

  • ☂️-@lemmy.ml
    link
    fedilink
    English
    arrow-up
    20
    ·
    17 hours ago

    letting sam altman (or billionaires for that matter) have all the money from our work is a poor allocation of resources.

  • weps@lemmy.world
    link
    fedilink
    English
    arrow-up
    9
    arrow-down
    3
    ·
    16 hours ago

    It’s true what he says and not just about RAM but about anything you own.

    My car isn’t driving most of the time. My drill isn’t drilling most of the time and my oven is off most of the time.

    That’s a huge waste of resources in a macro economic kind of way.

    You can’t argue with the correctness of his statement. You need other arguments. These arguments exist.

      • weps@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        9 hours ago

        I like the idea of collectively owning the computing power!

        Would be nice to be able to buy part of a datacenter instead of renting it.

    • sartalon@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      9 hours ago

      Defending that an argument CAN be true in an extremely narrow subset is an example of a really stupid argument, and only highlights the stupidity of the original argument.

      • weps@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        9 hours ago

        I didn’t mean to imply a narrow subset. Pretty much everything I own is idle and unused most of the time.

        I don’t think I understand what you’re saying, sorry.

    • Saledovil@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      3
      ·
      10 hours ago

      You can’t argue with the correctness of his statement. You need other arguments. These arguments exist.

      Here’s a counterargument: The resources wouldn’t be scarce if his company didn’t buy all of it for exetremely questionable gain. (Three years into the bubble, and AI compute is still being sold at a subsidized rate. You’d think if enough genuine demand existed to justify the buildout, you’d have to pay dearly for any AI use.

  • plissken@piefed.social
    link
    fedilink
    English
    arrow-up
    5
    ·
    17 hours ago

    Finally coming out of the bloody closet. Frontier labs and Nvidia are in death dance.

    The latter sells mostly to the former, but their growth story needs local inference to keep up with valuation. Nvidia could reduce prices on a whim and boost local inference, but that would make its investment in frontier labs lose too much.

    Frontier labs meanwhile need public markets money, and their story really needs local inference to be more expensive/extremely worst than what they offer.

    One narrative takes money away from.one side and puts it in the pockets of the other.

  • iocase@lemmy.zip
    link
    fedilink
    English
    arrow-up
    16
    ·
    1 day ago

    Please don’t run AI for free on your own workstation 😭 it’s a very bad use of your computer 😥

  • Wirlocke@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    5
    ·
    19 hours ago

    But buying up the world’s silicon wafers that you don’t even have the ability to turn into chips is a much better use of resources, right Sammy?

  • SparroHawc@lemmy.zip
    link
    fedilink
    English
    arrow-up
    27
    ·
    1 day ago

    And who made those resources scarce, Sam? WHO MADE THEM SCARCE???

    also screw you for trying to make the answer to ‘How should those resources be allocated?’ be ‘In the way that best enriches me personally’.

      • joeshmoe@infosec.pub
        link
        fedilink
        English
        arrow-up
        2
        ·
        23 hours ago

        I think it has to be with the way all the media channels ( controlled by the rich in power) essential brainwash people into not acting. Money and capitalism slowly corrupted the process of democracy and will see after Nov 3 if there is away to hold the rich in check.

  • Redvenom@retrolemmy.com
    link
    fedilink
    English
    arrow-up
    12
    ·
    1 day ago

    you are not getting it, if I have all the ram and I’m just going to charge you the amount I decided for you to be able to perform the most mundane tasks, I can’t believe you are not grasping the benefits of this business model