pepy.tech

vllm-cli

0.2.5
5.09k

A CLI tool to conveniently serve LLMs with vLLM