Benchmark results

[sshleifer]

I see many benchmark scripts, and I was wondering if there are aggregated results vs VLLM for different models/input lengths/output lengths so that I dont have to rerun them all.

[b8zhong]

It depends on your model and usecase. But generally SGLang is a bit faster

https://modal.com/llm-almanac/summary