Nick Hill 6bf3b46d78 [ModelRunner V2] Misc code simplification and cleanup (#33266) ...

Signed-off-by: Nick Hill <nickhill123@gmail.com>

2026-01-28 14:41:23 -08:00

..

gpu

[ModelRunner V2] Misc code simplification and cleanup (#33266)

2026-01-28 14:41:23 -08:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877)

2026-01-23 09:56:48 -08:00

cp_utils.py

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877)

2026-01-23 09:56:48 -08:00

cpu_model_runner.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

cpu_worker.py

[CPU Backend] [Perf] Accelerate tensor-parallel/data-parallel inference across NUMA domains on Arm (#32792)

2026-01-22 18:55:23 +00:00

dp_utils.py

[feature] extend DBO to XBO (#30120)

2025-12-16 00:04:01 -05:00

ec_connector_model_runner_mixin.py

[Chore] Remove unused noqas (#31263)

2025-12-24 05:38:46 -08:00

gpu_input_batch.py

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877)

2026-01-23 09:56:48 -08:00

gpu_model_runner.py

[Feature] Fully support for async scheduling + PP, 30.8% E2E throughput improvement, 31.8% TPOT improvement (#32618)

2026-01-28 20:30:32 +00:00

gpu_ubatch_wrapper.py

[Performance] Split FlashAttn attention and cache update (#25954)

2026-01-23 17:28:06 -08:00

gpu_worker.py

[ModelRunner V2] Misc code simplification and cleanup (#33266)

2026-01-28 14:41:23 -08:00

kv_connector_model_runner_mixin.py

[Cleanup] Remove unused KVConnectorModelRunnerMixin methods (#32077)

2026-01-21 11:16:37 +08:00

lora_model_runner_mixin.py

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674)

2025-12-26 04:48:20 -08:00

mamba_utils.py

[Bugfix][CI] Fix pre-commit (#32956)

2026-01-23 10:26:56 -08:00

tpu_input_batch.py

[Cleanup] Remove unused ModelRunner V1 InputBatch.num_tokens field (#30218)

2025-12-18 09:17:00 -08:00

ubatch_utils.py

[6/N][Attention] Move utils to more appropriate locations (#32215)

2026-01-13 05:38:52 -08:00

ubatching.py

[feature] extend DBO to XBO (#30120)

2025-12-16 00:04:01 -05:00

utils.py

[5/N][Attention] Finish eliminating vllm/attention folder (#32064)

2026-01-27 10:02:51 -05:00

worker_base.py

[2/N] Move cache factories to MM registry (#32382)

2026-01-15 01:02:30 -08:00

workspace.py

[BugFix] Fix memory spike in workspace allocation (#30744)

2025-12-16 06:46:22 -08:00

xpu_model_runner.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

xpu_worker.py

[Perf] Cache xpu_get_mem_info() result to avoid duplicate calls (#32983)

2026-01-23 20:56:23 -08:00