Ollama
ollama.ai
Get up and running with large language models.

If you’re just wanting to run LLMs quickly on your computer in the command line, this is about as simple as it gets. Ollama provides an easy CLI to generate text, and there’s also a Raycast extension for more powerful usage.

  • varsock@programming.dev
    1·
    7 months ago

    when running models locally, I presume the models are trained and the weights and stuff are exported to a “model.” For example Meta’s LLama model.

    Do these models get updated, new versions released? I don’t quite understand