• Scrubbles@poptalk.scrubbles.tech
    link
    fedilink
    English
    arrow-up
    12
    ·
    6 days ago

    I still think we’re coming into the worst of it before it comes back down. NVidia and Microsoft are pulling back on datacenter deployments and CXMT is finishing up their rampup. CXMT has basically said it’ll take on all of China’s demand which is a massive blow to the big three’s cartel, and then with slowing datacenters and obvious pushback it seems inevitable. Maybe not back to the prices from before, but I think we’ll see a downturn. Combine that with they’re trying to force companies into 5 year pricelocks shows they don’t think this pricing will last forever, otherwise they’d be telling them to buy at market rate.

    • terranoid@lemmy.cafe
      link
      fedilink
      English
      arrow-up
      11
      ·
      6 days ago

      I agree, but mostly because the bubble looks ready to pop. This is completely fucking unsustainable. They’re probably raising RAM prices to absurd levels just to squeeze the final but of wealth investors are willing to spend, before they give up and the house of cards comes crashing down.

      OpenAI and Anthropic arent profitable, but they’re basically hyping the entire US economy right now. There’s no way to make this work long term. You cant pay back a trillion dollars by scraping data you generate non deterministically. That’s most of what LLM is until they make AGI as promised, which they won’t.

  • earl_emorning@lemmy.zip
    link
    fedilink
    English
    arrow-up
    11
    ·
    6 days ago

    This is depressing because this is the year I wanted to start homelabbing and I’m not even looking for anything fancy but the prices are just too ridiculous. I really hope we see a downturn in the not so distant future.

      • earl_emorning@lemmy.zip
        link
        fedilink
        English
        arrow-up
        1
        ·
        10 hours ago

        Yeah that is true, but just the general demand for it and shortage has driven the price of pretty much everywhere. But yes my best bet is used hardware.

      • mushroommunk@lemmy.today
        link
        fedilink
        English
        arrow-up
        4
        ·
        5 days ago

        I don’t know about them but around me even used has gotten insane. You can still find deals if you know what to look for but someone new to homelab may not.

    • terranoid@lemmy.cafe
      link
      fedilink
      English
      arrow-up
      1
      ·
      6 days ago

      You could just fuck with raspberry pis and cheaper options and still do a ton of homelab stuff.

      • earl_emorning@lemmy.zip
        link
        fedilink
        English
        arrow-up
        1
        ·
        10 hours ago

        Unfortunately a 16GB Pi 5 where I live is $500 alone just for the board. Better off getting a mini PC for that price.

        • terranoid@lemmy.cafe
          link
          fedilink
          English
          arrow-up
          1
          ·
          4 hours ago

          Seriously, try older models. For a lot of homelab experimentation, you can do fine with 1 to 4 GB ram older pis, like pi 3 or 4. The price is going to be way lower in comparison to a pi 5.

          It depends of course on what you’re doing, but there’s a tendency for people to get the latest and greatest pi when older are just fine and far cheaper.

          • earl_emorning@lemmy.zip
            link
            fedilink
            English
            arrow-up
            1
            ·
            3 hours ago

            Yeah I think for the experimentation the older models would be fine and I am looking at getting one for cheaper, there is no stock anywhere at the moment either rn, but I was hoping to have a Jellyfin media server + arr stack and don’t think I would be able to run that smoothly with just a Pi. For lighterweight services I could definitely get that, I was even looking at alternative SBCs from aliexpress around same compute power but cheaper.