• 15 Posts
  • 5.44K Comments
Joined 3 years ago
cake
Cake day: August 24th, 2023

help-circle








  • There’s one company trying to etch models into the silicon, they got a working prototype in a 8b model and it does 17k t/s. They suggest at data center scales with bigger models it’d pay for itself in a year in saved costs in electricity, cooling, space required etc.

    You can apply lora’s to it, but it will fall behind as it ages, im not quite sure how long a static model would last to make up the money after that 1st year, but for something like creative writing where it doesnt need current data (e.g programming but the languages are always changing and evolving is a problem) it might work?







  • If youre going around the world, you’re going through multiple connection points which will absolutely add up. Going from LA to NYC, it probably wouldn’t be.

    And these data centers satellites are small. Stop thinking massive things, they’re going to be like the v3 starlink dishes but a little bigger. They’re going to launch multiple data center dishes per launch like how starlink v3 will be 60, not 1 or 2. SpaceX already knows how to radiate heat away on the satellites they launch, this isnt going to be an issue for them, they already do it today.

    Edit: like size wise you need to be thinking like a server rack, plus the huge folding solar array/radiator for it. They already know how to make the folding solar panels as well. And the rack will probably be long and narrow so they can angle it best against the sun so it gets as least heat as possible from it, not a chubby thing with a lot of surface on all sides.

    Edit: also land based routing isn’t direct increasing the distance likely substantially, potentially more than the up and down, the massive starlink constellation it will be more direct.






  • You dont need to worry about land, power, red tape or NIMBY s in space which are big problems. The sun is always shining in a sun synchronous orbit, and space is plentiful. People think these are going to be massive megawatt things as well, but they arent, they’re going to be small satellites, so each one doesnt have as much heat to deal with as people think, and they know how to radiate heat away, they already do it on their satellites.

    SpaceX also knows how to make relatively cheap satellites as demonstrated with Starlink where its a mass manufacturing line for them which brings costs down.

    With starlink though people actually need the service and its worth paying for if you’re in an area that needs it. Its hard to say the same about all this AI stuff, so even if they can do it, we still haven’t seen that its profitable, that enough people want it, and that people wont eventually turn to a local AI if they do want it. So its possible, but its not solving a need as big as starlink is, so it could be an utter failure even if technically possible.

    Personally I dont think its going to work because they wont get enough use to be profitable, not because the idea wont work or wouldn’t work if enough people wanted it.

    Edit: also SpaceX has a proven track record of being able to launch satellites at a high cadence, so its just a matter of will starship be rapidly reusable. Starship has to be rapidly reusable for this work. If it turns out its only reusable after heavy refurbishment, that really messes with the economics of everything.