← Back to post

Edit history

Most recent

You shouldn’t let that discourage you. VLLM is really finicky, but there are easier backends to use (though which one depends on your hardware).

Original

You shouldn’t let that discourage you. VLLM is really finicky, but there are easier backends to use.