[HN Gopher] Fast and Expressive LLM Inference with RadixAttentio...
___________________________________________________________________
Fast and Expressive LLM Inference with RadixAttention and SGLang
Author : MMMercy2
Score : 6 points
Date : 2024-01-17 17:08 UTC (5 hours ago)
(HTM) web link (lmsys.org)
(TXT) w3m dump (lmsys.org)
___________________________________________________________________
(page generated 2024-01-17 23:01 UTC)