Chen Zhang 6550114c9c [v1] Redo "Support multiple KV cache groups in GPU model runner (#17945)" (#18593) ...

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

2025-05-23 09:39:47 -07:00

..

mla

[v1] Redo "Support multiple KV cache groups in GPU model runner (#17945)" (#18593)

2025-05-23 09:39:47 -07:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

flash_attn.py

[v1] Pass BlockTable and KVCacheSpec to AttentionMetadataBuilders (#17483)

2025-05-10 16:12:04 -07:00

flashinfer.py

[Bugfix][V1] Fix FlashInfer V1 backend using the wrong VllmConfig (#18086)

2025-05-13 20:36:17 -07:00

pallas.py

[TPU] Fix the test_sampler (#17820)

2025-05-08 05:51:33 -04:00

triton_attn.py

[Bugfix][ROCm] Use chunked_prefill_paged_decode as fallback for V1 attention on ROCm (#18093)

2025-05-15 19:30:17 -07:00

utils.py

[v1] AttentionMetadata for each layer (#17394)

2025-05-06 07:58:37 -07:00