Toes, 7 months ago

koboldcpp works fairly well. There’s lots of different models to try and the choice depends a fair bit on your computer specs and what you wanna do with it. github.com/LostRuins/koboldcpp

I like generating short stories