Lucas Wilkinson dc464a3d39 [BugFix] AssertionError: Do not capture num_reqs > max_num_reqs for uniform batch (#25505) ...

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

2025-09-23 18:00:29 -06:00

..

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[Core] Use CpuGpuBuffer for block table tensors (#24795)

2025-09-16 19:18:06 -07:00

cpu_model_runner.py

[Core] Modify the initialization parameters of the lora manager (#25249)

2025-09-19 18:01:28 +00:00

cpu_worker.py

[Bugfix] Fix sequence parallelism bug when enable pipeline parallelism (#24021)

2025-09-16 04:32:32 +00:00

gpu_input_batch.py

[CORE] Prompt Embeddings Support for v1 Engine (#24278)

2025-09-19 08:03:09 +08:00

gpu_model_runner.py

[BugFix] AssertionError: Do not capture num_reqs > max_num_reqs for uniform batch (#25505)

2025-09-23 18:00:29 -06:00

gpu_ubatch_wrapper.py

[core] add nccl symmetric memory for all reduce (#24532)

2025-09-23 14:33:06 -04:00

gpu_worker.py

[BugFix] Fix OOM in vLLM replicas by ensuring consistent NCCL memory accounting (#25359)

2025-09-23 15:49:09 -07:00

kv_connector_model_runner_mixin.py

[Bugfix] Fix missing clear_connector_metadata (#25397)

2025-09-23 08:10:59 +08:00

lora_model_runner_mixin.py

[Core] Modify the initialization parameters of the lora manager (#25249)

2025-09-19 18:01:28 +00:00

tpu_input_batch.py

[CORE] Prompt Embeddings Support for v1 Engine (#24278)

2025-09-19 08:03:09 +08:00

tpu_model_runner.py

[TPU] Deprecate xm.mark_step in favor of `torch_xla.sync (#25254)

2025-09-22 10:12:57 +00:00

tpu_worker.py

[P/D] Add a shutdown method to the Connector API (#22699)

2025-09-07 23:07:00 -07:00

ubatch_splitting.py

[Core/DBO][2/N] Dual-Batch Overlap add DeepEP High Throughput support and Prefill support (#24845)

2025-09-23 16:02:10 +00:00

ubatch_utils.py

[Core/DBO][2/N] Dual-Batch Overlap add DeepEP High Throughput support and Prefill support (#24845)

2025-09-23 16:02:10 +00:00

ubatching.py

[Core/DBO][2/N] Dual-Batch Overlap add DeepEP High Throughput support and Prefill support (#24845)

2025-09-23 16:02:10 +00:00

utils.py

[Core/DBO][2/N] Dual-Batch Overlap add DeepEP High Throughput support and Prefill support (#24845)

2025-09-23 16:02:10 +00:00

worker_base.py

[Docs] Fix warnings in mkdocs build (continued) (#23743)

2025-08-27 17:17:29 +00:00

xpu_model_runner.py

[XPU] Fix xpu model runner call torch.cuda APIs (#25011)

2025-09-17 06:45:25 +00:00

xpu_worker.py

[Doc]: fix typos in Python comments (#24115)

2025-09-02 21:14:07 -07:00