“Local roleplayers” who’ve been running GPT-J finetunes on desktops before ChatGPT was even a thing saw this coming a mile away. Look up Pygmalion, Janeway, all those finetunes that predate even Llama 1.
One can run a not-terrible RP bot on 8GB+ phones or decent PCs, or use Kobold Horde bots that are at least ostensibly privacy friendly and totally free. Sometimes I host one for others when my GPU is idle.
…A problem, as always, is shitty capitalism and enshittification. App stores have no incentive to show free, locally runnable stuff to people.
“Local roleplayers” who’ve been running GPT-J finetunes on desktops before ChatGPT was even a thing saw this coming a mile away. Look up Pygmalion, Janeway, all those finetunes that predate even Llama 1.
One can run a not-terrible RP bot on 8GB+ phones or decent PCs, or use Kobold Horde bots that are at least ostensibly privacy friendly and totally free. Sometimes I host one for others when my GPU is idle.
…A problem, as always, is shitty capitalism and enshittification. App stores have no incentive to show free, locally runnable stuff to people.