Li, Jiang 5c057e068f [CPU] Refine batch reorder of CPU attention backend (#26096) ...

Signed-off-by: jiang1.li <jiang1.li@intel.com>

2025-10-04 21:54:35 +08:00

..

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[Core] Use CpuGpuBuffer for block table tensors (#24795)

2025-09-16 19:18:06 -07:00

cpu_model_runner.py

[CPU] Refine batch reorder of CPU attention backend (#26096)

2025-10-04 21:54:35 +08:00

cpu_worker.py

[CPU] update torch 2.8 and fix missing fields in TorchSDPAMetadata (#25652)

2025-09-25 13:29:11 +00:00

gpu_input_batch.py

[Misc] Require merge_by_field_config argument (#26214)

2025-10-04 01:40:14 -07:00

gpu_model_runner.py

[V1] [Hybrid] Mamba2 Automatic Prefix Caching (#25752)

2025-10-04 06:34:22 +02:00

gpu_ubatch_wrapper.py

Reduce the Cuda Graph memory footprint when running with DBO (#25779)

2025-09-26 22:29:56 +00:00

gpu_worker.py

[V1] [P/D] Add Support for KV Load Failure Recovery (#19330)

2025-09-30 14:57:08 -07:00

kv_connector_model_runner_mixin.py

[V1] [P/D] Add Support for KV Load Failure Recovery (#19330)

2025-09-30 14:57:08 -07:00

lora_model_runner_mixin.py

[Core] Modify the initialization parameters of the lora manager (#25249)

2025-09-19 18:01:28 +00:00

tpu_input_batch.py

[CORE] Prompt Embeddings Support for v1 Engine (#24278)

2025-09-19 08:03:09 +08:00

tpu_model_runner.py

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896)

2025-09-30 17:14:41 +08:00

tpu_worker.py

[TPU][Bugfix] fix the missing apply_model in tpu worker (#25526)

2025-09-24 05:18:08 +00:00

ubatch_splitting.py

[BugFix] Fix using dbo_decode_token_threshold always (and ignoring dbo_prefill_token_threshold) (#25622)

2025-09-26 16:22:49 +00:00

ubatch_utils.py

[Core/DBO][2/N] Dual-Batch Overlap add DeepEP High Throughput support and Prefill support (#24845)

2025-09-23 16:02:10 +00:00

ubatching.py

[Core/DBO][2/N] Dual-Batch Overlap add DeepEP High Throughput support and Prefill support (#24845)

2025-09-23 16:02:10 +00:00

utils.py

[Model] Add LongCat-Flash (#23991)

2025-09-24 21:53:40 -07:00

worker_base.py

[V0 Deprecation] Remove vllm.worker and update according imports (#25901)

2025-09-29 23:26:11 +00:00

xpu_model_runner.py

[XPU] Fix xpu model runner call torch.cuda APIs (#25011)

2025-09-17 06:45:25 +00:00

xpu_worker.py

[Doc]: fix typos in Python comments (#24115)

2025-09-02 21:14:07 -07:00