6 people 567939953b [Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693) ...

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

2025-09-16 12:21:48 -04:00

..

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

fix some typos (#24616)

2025-09-11 10:48:46 -07:00

cpu_model_runner.py

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

2025-09-16 12:21:48 -04:00

cpu_worker.py

[Bugfix] Fix sequence parallelism bug when enable pipeline parallelism (#24021)

2025-09-16 04:32:32 +00:00

gpu_input_batch.py

[Multimodal] Remove legacy multimodal fields in favor of MultiModalFeatureSpec (#24548)

2025-09-12 21:42:23 +08:00

gpu_model_runner.py

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

2025-09-16 12:21:48 -04:00

gpu_ubatch_wrapper.py

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

2025-09-16 12:21:48 -04:00

gpu_worker.py

[Bugfix] Fix sequence parallelism bug when enable pipeline parallelism (#24021)

2025-09-16 04:32:32 +00:00

kv_connector_model_runner_mixin.py

[BugFix] Fix pipeline parallel (#24621)

2025-09-10 23:05:30 -07:00

lora_model_runner_mixin.py

[Bugfix] Fix GPUModelRunner has no attribute lora_manager (#24762)

2025-09-12 23:55:14 -07:00

tpu_input_batch.py

[Doc]: fix typos in various files (#24726)

2025-09-12 06:43:12 -07:00

tpu_model_runner.py

[Multimodal] Remove legacy multimodal fields in favor of MultiModalFeatureSpec (#24548)

2025-09-12 21:42:23 +08:00

tpu_worker.py

[P/D] Add a shutdown method to the Connector API (#22699)

2025-09-07 23:07:00 -07:00

ubatch_splitting.py

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

2025-09-16 12:21:48 -04:00

ubatch_utils.py

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

2025-09-16 12:21:48 -04:00

ubatching.py

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

2025-09-16 12:21:48 -04:00

utils.py

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

2025-09-16 12:21:48 -04:00

worker_base.py

[Docs] Fix warnings in mkdocs build (continued) (#23743)

2025-08-27 17:17:29 +00:00

xpu_model_runner.py

[XPU]fix cuda event used in XPU model runner (#23708)

2025-08-27 07:27:14 +00:00

xpu_worker.py

[Doc]: fix typos in Python comments (#24115)

2025-09-02 21:14:07 -07:00