Edit history

sleepingrobots.com/dreams/stop-using-ollama/

And this is just the tip of the iceberg for ollama. They’re the same kind of scammy tech bros as OpenAI.

The best setup depends on your hardware. There is no “easy button” unfortunately, quantized LLMs are just too intense and finicky to run without making some informed choices.

It also depends on what you want to do with the LLM. For example, some are too slow or bad at long context for agenic use, some quantizations are great at scripts but terrible outside that, or vice versa.

But LM Studio and Qwen 3.5 35B Q4 is probably the “easiest” flat recommendation I can make.

Or… honestly, just pay $40 for basically unlimited usage for a year from an API, then roll your own frontend.

sleepingrobots.com/dreams/stop-using-ollama/

And this is just the tip of the iceberg for ollama. They’re the same kind of scammy tech bros as OpenAI.

The best setup depends on your hardware. There is no “easy button” unfortunately, quantized LLMs are just too intense and finicky to run without making some informed choices. It also depends on what you want to do with the LLM.

But LM Studio and Qwen 3.5 35B IQ4_XS is probably the “easiest” flat recommendation I can make.

Or… honestly, just pay $40 for basically unlimited usage for a year from an API, then roll your own frontend.

sleepingrobots.com/dreams/stop-using-ollama/

And this is just the tip of the iceberg for ollama. They’re the same kind of scammy tech bros as OpenAI.

The best setup depends on your hardware. There is no “easy button” unfortunately, quantized LLMs are just too intense and finicky to run without making some informed choices. It also depends on what you want to do with the LLM.

But LM Studio and Qwen 3.5 35B IQ4_XS is probably the “easiest” flat recommendation I can make.

Or… honestly, just pay like $40 for basically unlimited usage for a year from an API, then roll your own frontend.

sleepingrobots.com/dreams/stop-using-ollama/

And this is just the tip of the iceberg for ollama. They’re the same kind of scammy tech bros as OpenAI.

The best setup depends on your hardware. There is no “easy button” unfortunately, they’re just too intense to run without making some informed choices. It also depends on what you want to do with the LLM.

But LM Studio and Qwen 3.5 35B IQ4_XS is probably the “easiest” flat recommendation I can make.

Or… honestly, just pay like $40 for basically unlimited usage for a year from an API, then roll your own frontend.

sleepingrobots.com/dreams/stop-using-ollama/

And this is just the tip of the iceberg for ollama. They’re basically the same kind of scammy tech bros as OpenAI.

The best setup depends on your hardware. There is no “easy button” unfortunately, they’re just too intense to run without making some informed choices. It also depends on what you want to do with the LLM.

But LM Studio and Qwen 3.5 35B IQ4_XS is probably the “easiest” flat recommendation I can make.

Or… honestly, just pay like $40 for basically unlimited usage for a year from an API, then roll your own frontend.