![](https://media.social.qoto.org/accounts/avatars/000/797/064/original/71901358fba0f45b.png)
![](https://fedia.io/media/c2/83/c2835efd001a7d403340d6b26ddd3a5ac40b49812d7f68db98854c57c1d93f47.png)
3·
5 months ago@[email protected] @[email protected] local LLM execution times can be very fast on recent consumer hardware. No need to send anywhere, just like their translation - do it all on-device.
As an example, with no optimization or GPU support, my @[email protected] (AMD) generates around 5 characters/sec from a 4 gigabyte pre-quantized model.
@henfredemars tried https://support.mozilla.org/en-US/kb/troubleshoot-and-diagnose-firefox-problems ?