c10l, 1 year ago

It’s pretty easy with Ollama. Install it, then ollama run mistral-7b (or another model, there’s a few available ootb). ollama.ai

Another option is Llamafile. github.com/Mozilla-Ocho/llamafile