c10l, 1 year ago It’s pretty easy with Ollama. Install it, then ollama run mistral-7b (or another model, there’s a few available ootb). ollama.ai Another option is Llamafile. github.com/Mozilla-Ocho/llamafile
It’s pretty easy with Ollama. Install it, then ollama run mistral-7b (or another model, there’s a few available ootb). ollama.ai
ollama run mistral-7b
Another option is Llamafile. github.com/Mozilla-Ocho/llamafile