Rui Qiao cea96a0156 [Bugfix] Fix sync_and_slice_intermediate_tensors (#21537) ...

Signed-off-by: Rui Qiao <ruisearch42@gmail.com>

2025-07-25 17:07:58 -07:00

..

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[Attention] Refactor attention metadata builder interface (#20466)

2025-07-17 04:44:25 +00:00

cpu_model_runner.py

[bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032)

2025-07-19 05:13:55 -07:00

cpu_worker.py

[bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032)

2025-07-19 05:13:55 -07:00

gpu_input_batch.py

[Sampler] Introduce logprobs mode for logging (#21398)

2025-07-23 01:39:25 -07:00

gpu_model_runner.py

[Bugfix] Fix sync_and_slice_intermediate_tensors (#21537)

2025-07-25 17:07:58 -07:00

gpu_worker.py

[V1] Get supported tasks from model runner instead of model config (#21585)

2025-07-25 05:36:45 -07:00

kv_connector_model_runner_mixin.py

[P/D] Support CPU Transfer in NixlConnector (#18293)

2025-07-24 17:58:42 +01:00

lora_model_runner_mixin.py

[V1] Decouple GPU and TPU InputBatch (#19778)

2025-06-18 06:38:13 +00:00

tpu_input_batch.py

Support embedding models in V1 (#16188)

2025-06-18 21:36:33 -07:00

tpu_model_runner.py

[V1] Get supported tasks from model runner instead of model config (#21585)

2025-07-25 05:36:45 -07:00

tpu_worker.py

[V1] Get supported tasks from model runner instead of model config (#21585)

2025-07-25 05:36:45 -07:00

utils.py

[MISC] Move bind_kv_cache to worker module (#20900)

2025-07-14 09:40:00 +00:00

worker_base.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

xpu_model_runner.py

[XPU][CI] enhance xpu test support (#20652)

2025-07-09 16:53:09 +00:00

xpu_worker.py

[XPU] Enable external_launcher to serve as an executor via torchrun (#21021)

2025-07-21 21:47:35 -07:00