vLLM has released version 0.28.0. This update provides the latest improvements and fixes to the high-throughput LLM serving engine.

Read original