[Dependency] Upgrade FlashInfer to 0.7.2 and restore KDA auto backend (#61913)
Signed-off-by: Anerudhan Gopal <agopal@nvidia.com> Co-authored-by: OpenAI Codex <noreply@openai.com>
This commit is contained in:
co-authored by
OpenAI Codex
parent
19b0efce30
commit
af28c171f5
@@ -456,7 +456,7 @@ def _flashinfer_kda_prefill(
|
||||
beta_is_logit=True,
|
||||
seq_order=seq_order,
|
||||
prefill_workspace=prefill_workspace,
|
||||
backend="cute-dsl",
|
||||
backend="auto",
|
||||
)
|
||||
return output, initial_state
|
||||
|
||||
|
||||
Reference in New Issue
Block a user