[Fix Bug]num_active_loras always equals to zero (#34119)

Signed-off-by: Runkai Tao <rt572@physics.rutgers.edu>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
This commit is contained in:
Runkai Tao
2026-03-02 23:17:46 +08:00
committed by GitHub
co-authored by Jee Jee Li
parent 7e9149d9a9
commit ada4f4fadd
7 changed files with 58 additions and 29 deletions
+1
View File
@@ -5379,6 +5379,7 @@ class GPUModelRunner(
# if we want to warm up attention or not. This is
# different from the case where `FULL` implies capture
# attention while `PIECEWISE` implies no attention.
dummy_run(
num_tokens,
cudagraph_runtime_mode=CUDAGraphMode.NONE,