yanghui1-arch 7151ae6528 [Bugfix] RoBERTa position_id accumulation in CUDA graph padding region (#37873) ...

Signed-off-by: dass90 <3053034939@qq.com>

2026-03-23 14:59:21 +00:00

..

gpu

[Feature] ViT Full CUDA Graph (#35963)

2026-03-23 13:01:10 +08:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877)

2026-01-23 09:56:48 -08:00

cp_utils.py

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877)

2026-01-23 09:56:48 -08:00

cpu_model_runner.py

[Bugfix] Fix CPU backend crash in KV cache block zeroing (#37550)

2026-03-23 11:35:45 +00:00

cpu_worker.py

[CPU][UX] Do not crash when tcmalloc/libiomp are not ldpreloaded (#37561)

2026-03-19 16:35:45 +00:00

dp_utils.py

[Log] Reduce duplicate log (#37313)

2026-03-18 10:57:44 -04:00

ec_connector_model_runner_mixin.py

[Misc] Introduce ec_both role EC (encoder cache) connector (#34182)

2026-02-10 18:55:35 +00:00

gpu_input_batch.py

[Bugfix] Fix pooling non-determinism from pinned prompt_lens aliasing (#37775)

2026-03-22 03:22:24 +00:00

gpu_model_runner.py

[Bugfix] RoBERTa position_id accumulation in CUDA graph padding region (#37873)

2026-03-23 14:59:21 +00:00

gpu_ubatch_wrapper.py

[Perf] Fix slow hasattr in CUDAGraphWrapper.__getattr__ (#37425)

2026-03-19 15:43:48 +08:00

gpu_worker.py

elastic_ep: Fix issues with repeated scale up/down cycles (#37131)

2026-03-20 23:13:02 +00:00

kv_connector_model_runner_mixin.py

[Bugfix] Disable cross-layer KV cache for MLA attention backends (#37090)

2026-03-16 19:03:10 +02:00

lora_model_runner_mixin.py

Reduce the kernel overhead when num of active loras is smaller than max loras. Multiple cuda graphs are captured for each num of active-loras. (#32005)

2026-02-02 12:30:06 -05:00

mamba_utils.py

[Hybrid] calling get_mamba_groups() once at MambaCopyBuffers.create() (#37318)

2026-03-21 09:29:43 +00:00

tpu_input_batch.py

[Cleanup] Remove unused ModelRunner V1 InputBatch.num_tokens field (#30218)

2025-12-18 09:17:00 -08:00

ubatch_utils.py

[6/N][Attention] Move utils to more appropriate locations (#32215)

2026-01-13 05:38:52 -08:00

ubatching.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

utils.py

[V0 Deprecation] Deprecate virtual engine (#37195)

2026-03-18 14:30:14 -07:00

worker_base.py

elastic_ep: Fix issues with repeated scale up/down cycles (#37131)

2026-03-20 23:13:02 +00:00

workspace.py

[1/N] Elastic EP Milestone 2 (#34861)

2026-02-28 04:46:42 +00:00

xpu_model_runner.py

[XPU] Enable ModelRunnerV2 on XPU (#36078)

2026-03-05 17:19:18 +00:00

xpu_worker.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00