Nick Hill 50aa830482 [BugFix][MRV2] Don't create dummy requests longer than max_model_len (#49751) ...

Signed-off-by: Nick Hill <nickhill123@gmail.com>

2026-07-27 02:04:20 +00:00

..

cpu

Revert "[Platform] Replace torch.cuda.Event with torch.Event (#47140)" (#47668)

2026-07-06 14:18:33 +01:00

gpu

[BugFix][MRV2] Don't create dummy requests longer than max_model_len (#49751)

2026-07-27 02:04:20 +00:00

sentinel

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

__init__.py

…

block_table.py

[Core] Add MRV2 virtual-batch PCP for MLA (#46570)

2026-07-19 02:53:15 +00:00

cp_utils.py

[Core] Add MRV2 virtual-batch PCP for MLA (#46570)

2026-07-19 02:53:15 +00:00

cpu_model_runner.py

[CPU] Remove speculative decoding stream overrides from CPUModelRunner (#47162)

2026-07-01 06:12:49 +00:00

cpu_worker.py

[CPU] Create Proper Numa topology for s390x (#40714)

2026-07-13 12:58:43 +08:00

dp_utils.py

…

ec_connector_model_runner_mixin.py

…

encoder_cudagraph_defs.py

…

encoder_cudagraph.py

…

gpu_input_batch.py

[Kernel] ReplaySSM: cache SSM inputs for faster Mamba2 standard decode (#48018)

2026-07-24 09:39:49 -07:00

gpu_model_runner.py

[Kernel] ReplaySSM: cache SSM inputs for faster Mamba2 standard decode (#48018)

2026-07-24 09:39:49 -07:00

gpu_ubatch_wrapper.py

[Bugfix] Fix UBatchWrapper CUDA graph key to sum all ubatches, not just first two (#43161)

2026-07-07 12:42:31 +00:00

gpu_worker.py

[Core][Distributed] Add process-checkpoint lifecycle hooks for communicators (starting with Flashinfer) (#46877)

2026-07-26 14:47:50 -04:00

kv_connector_model_runner_mixin.py

[Bugfix][KVConnector] Disable cross-layer KV blocks for per-token-head quant (#49226)

2026-07-26 05:24:27 +03:00

lora_model_runner_mixin.py

…

mamba_utils.py

[Perf][Hybrid] Vectorize _copy_mamba_state_block to uint64 for temporal (#48110)

2026-07-18 04:43:09 +00:00

startup_plan.py

[Core] Persist and reuse the memory-profiling result across boots (opt-in) (#47388)

2026-07-08 00:53:02 +00:00

tpu_input_batch.py

DCP supports hybrid attention (#40996)

2026-07-09 21:34:45 -07:00

ubatch_utils.py

…

ubatching.py

…

utils.py

[Bugfix] Support non-uniform page sizes in KVBlockZeroer (#49704)

2026-07-24 13:38:59 -07:00

worker_base.py

…

workspace.py

…

xpu_model_runner.py

[XPU] Fix Event init failure w/ blocking (#47868)

2026-07-07 22:54:03 +08:00

xpu_worker.py

[Doc] Fix grammatically incorrect error message in gpu_worker and xpu_worker (#36715)

2026-07-07 17:03:06 +00:00