Wow, what an excellent essay. Linked to the archived version because it is The Atlantic and I hate them.

It is worth thinking what LLMs as a product would look like if they were not designed from the ground up to con you into thinking they were conscious-adjacent.