CubitOom, 1 year ago Checkout ollama. There’s a lot of models you can pull from the official library. Using ollama, you can also run external gguf models found on places like huggingface if you use a modelfile with something as simple as <span style="color:#323232;">echo "FROM ~/Documents/ollama/models/$model_filepath" >| ~/Documents/ollama/modelfiles/$model_name.modelfile </span>
Checkout ollama.
There’s a lot of models you can pull from the official library.
Using ollama, you can also run external gguf models found on places like huggingface if you use a modelfile with something as simple as
<span style="color:#323232;">echo "FROM ~/Documents/ollama/models/$model_filepath" >| ~/Documents/ollama/modelfiles/$model_name.modelfile </span>