Absolutely needed: to get high efficiency for this beast … as it gets better, we’ll become too dependent.
“all of this growth is for a new technology that’s still finding its footing, and in many applications—education, medical advice, legal analysis—might be the wrong tool for the job,”
Depends on the prompt, the model, the parameters, which DCs, time of day, location in the world, and other factors. They answer the question but there’s so many variables that can affect footprint (and big hyperscalers do not release this data so you have to under a lot)