The Lemmy Club
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to Technology@lemmygrad.mlEnglish · 2 days ago

If this is true, the hyperscalers are toast

klementoninvesting.substack.com

external-link
message-square
11
link
fedilink
  • cross-posted to:
  • technology@lemmy.ml
  • hackernews@lemmy.bestiver.se
  • technology@midwest.social
21
external-link

If this is true, the hyperscalers are toast

klementoninvesting.substack.com

☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to Technology@lemmygrad.mlEnglish · 2 days ago
message-square
11
link
fedilink
  • cross-posted to:
  • technology@lemmy.ml
  • hackernews@lemmy.bestiver.se
  • technology@midwest.social
In my regular research (behind a paywall), I have been saying for a while that I think the future of AI is not large language models (LLM), but small language models (SLM) run on local desktop computers or even mobile phones.
alert-triangle
You must log in or register to comment.
  • burlemarx@lemmygrad.mlM
    link
    fedilink
    arrow-up
    12
    ·
    1 day ago

    Oh my goodness, the needle is getting closer to the bubble at each passing day. Thank you for the good news!

    • ☆ Yσɠƚԋσʂ ☆@lemmygrad.mlOP
      link
      fedilink
      arrow-up
      11
      ·
      1 day ago

      O7

  • NothingButBits@lemmygrad.ml
    link
    fedilink
    arrow-up
    15
    ·
    2 days ago

    But this is always how computers tend to evolve. First you start with a giant centralized mainframe, and eventually you miniaturize it into a laptop or phone. Let’s hope these SLMs really do take off, for environmental and privacy concerns.

    • ☆ Yσɠƚԋσʂ ☆@lemmygrad.mlOP
      link
      fedilink
      arrow-up
      12
      ·
      1 day ago

      Exactly, we’re in the mainframe era of this tech, and it’s already coming to an end. I’m really optimistic we’ll see local models in wide use before long. Alibaba is already making chips specifically for that use case too https://wccftech.com/alibabas-tsmc-built-5nm-risc-v-chip-xuantie-c950-now-runs-qwen-3-8-27b-model-natively-unlocking-massive-vertical-integration-tailwinds/

      • burlemarx@lemmygrad.mlM
        link
        fedilink
        arrow-up
        12
        ·
        1 day ago

        Oh yes, what a bright future, open source ISAs, open source SLMs, open source agents (not there yet, but getting closer…)! Hope we get fully automated luxury communism at some point after as well.

        • ☆ Yσɠƚԋσʂ ☆@lemmygrad.mlOP
          link
          fedilink
          arrow-up
          12
          ·
          1 day ago

          and it will all be built in China too

  • Che's Motorcycle@lemmygrad.ml
    link
    fedilink
    arrow-up
    9
    ·
    1 day ago

    I suspect we’re well into diminishing returns for the hyperscaling approach. The difference between frontier models now and three years ago is exponential. But between now and three to six months ago? Both are nearing their upper limits – throwing more money at them won’t change much, not without a fundamentally different approach.

    • ☆ Yσɠƚԋσʂ ☆@lemmygrad.mlOP
      link
      fedilink
      arrow-up
      7
      ·
      1 day ago

      That’s my impression as well. Seems like we’re reaching a plateau of what the current architecture can do. And it also becomes a race to the bottom. Labs have to spend more and more money to squeeze out ever smaller improvements, so it’s very hard to differentiate yourself from the competition.

  • loathsome dongeater@lemmygrad.ml
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 day ago

    I really just need openai or anthropic to either become profitable or fuck off. I am really sick of them.

    • ☆ Yσɠƚԋσʂ ☆@lemmygrad.mlOP
      link
      fedilink
      arrow-up
      7
      ·
      1 day ago

      My prediction is that one of them will become a vendor of record for the government and get a bailout, and the other will die off.

  • burlemarx@lemmygrad.mlM
    link
    fedilink
    arrow-up
    5
    ·
    1 day ago

    Oh my goodness, the needle is getting closer to the bubble at each passing day. Thank you for the good news!

Technology@lemmygrad.ml

technology@lemmygrad.ml

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@lemmygrad.ml

A tech news sub for communists

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 12 users / day
  • 98 users / week
  • 255 users / month
  • 735 users / 6 months
  • 5 local subscribers
  • 1.47K subscribers
  • 2.3K Posts
  • 6.33K Comments
  • Modlog
  • mods:
  • Muad'Dibber@lemmygrad.ml
  • burlemarx@lemmygrad.ml
  • egs81t@lemmygrad.ml
  • BE: 0.19.20
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org