Yong Hoon Shin 3e2f7985a2 Support multiple attention groups for KV sharing (#22672) ...

Signed-off-by: Yong Hoon Shin <yhshin@meta.com>

2025-08-15 16:54:10 -07:00

..

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[Core] direct indexing on self.block_table_np in compute_slot_mapping (#22940)

2025-08-15 12:12:12 -07:00

cpu_model_runner.py

[Attention] Support multiple attention metadata builders per kv_cache_spec + proper local attention no hybrid kv cache fix (#21588)

2025-08-06 18:40:52 -07:00

cpu_worker.py

[bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032)

2025-07-19 05:13:55 -07:00

gpu_input_batch.py

[Core] Use individual MM items in P0/P1 cache and model runner (#22570)

2025-08-13 07:18:07 -07:00

gpu_model_runner.py

[Structured Outputs] [Bug] Fix misalignment in apply_grammar_bitmask causing unintended masking and NaN logits (#22963)

2025-08-15 23:25:05 +00:00

gpu_worker.py

[Core] Allow full cudagraph with separate attention routines and orthogonal to compilation, add support for FA2 and FlashInfer (#20059)

2025-08-15 10:01:39 -04:00

kv_connector_model_runner_mixin.py

[V0 deprecation][P/D] Deprecate v0 KVConnectorBase code (1/2) (#21785)

2025-08-04 19:11:33 -07:00

lora_model_runner_mixin.py

[V1] Decouple GPU and TPU InputBatch (#19778)

2025-06-18 06:38:13 +00:00

tpu_input_batch.py

Support embedding models in V1 (#16188)

2025-06-18 21:36:33 -07:00

tpu_model_runner.py

[MM] Allow skipping memory profiling for multimodal models. (#22950)

2025-08-15 11:41:38 +00:00

tpu_worker.py

[V1] Get supported tasks from model runner instead of model config (#21585)

2025-07-25 05:36:45 -07:00

utils.py

Support multiple attention groups for KV sharing (#22672)

2025-08-15 16:54:10 -07:00

worker_base.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

xpu_model_runner.py

[XPU][CI] enhance xpu test support (#20652)

2025-07-09 16:53:09 +00:00

xpu_worker.py

[XPU] upgrade torch 2.8 on for XPU (#22300)

2025-08-08 17:03:45 -07:00