posted in Technology
Why your local LLM feels dumber than it is
forum.level1techs.com/t/why-your-local-llm-feels-dumber-than-it-is/253917posted in Technology
Why your local LLM feels dumber than it is
forum.level1techs.com/t/why-your-local-llm-feels-dumber-than-it-is/253917This really killed a wish to run local LLMs. So fiddly…
Not any more than any other local service. Ollama makes it really easy to get started. The ministral models are small but still useful.
Replying to @frongt@lemmy.zip
Pretty funny. Most of this article was saying that ollama sucks now and they’re just popular because there were one of the first.
Personally I started with them, too, but constantly ran into issues with them. I’ve have much better experiences with jan, open web UI, and LM studio. The first two are foss, and the second properly attributes their use of open source projects, unlike ollama.
Edit: nevermind, it’s the link below me. It’s still early in the morning, my bad