Yifan Qiao cd4a95e3aa [Feat][Core] Support multiple KV cache groups in Hybrid KV Coordinator (#31707) ...

Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>

2026-01-09 10:53:20 -08:00

..

attention

[CPU] Add head sizes 80 and 112 with vec16 fallback (#31968)

2026-01-09 22:14:46 +08:00

core

[Feat][Core] Support multiple KV cache groups in Hybrid KV Coordinator (#31707)

2026-01-09 10:53:20 -08:00

engine

[Async][Feat] support apply penalty or bad_words for async + spec (#30495)

2026-01-09 02:31:50 +00:00

executor

[Chore] Try remove init_cached_hf_modules (#31786)

2026-01-07 12:34:04 +08:00

kv_offload

CPU KV Offloading: Use more CUDA streams (#29013)

2025-12-14 23:50:45 +00:00

metrics

[Metrics] Model FLOPs Utilization estimation (#30738)

2025-12-18 01:40:51 +00:00

pool

[Refactor] Clean up pooler modules (#31897)

2026-01-08 00:07:43 +08:00

sample

[BugFix] Fix bad words with speculative decoding (#31908)

2026-01-07 15:46:42 -05:00

spec_decode

[ROCm][CI][V1] Fix nixl_connector test failure and achieve CUDA parity in test_async_scheduling (#32000)

2026-01-09 20:48:32 +08:00

structured_output

[Misc] Various code simplifications (#31666)

2026-01-04 18:35:56 -08:00

worker

[UX] Add vLLM model inspection view (#29450)

2026-01-09 10:12:35 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[BugFix] Fix assert batch_descriptor.num_tokens == num_tokens_padded (#30173)

2025-12-09 10:36:12 -05:00

kv_cache_interface.py

Decouple page_size_bytes calculation in AttentionSpec for TPU/RPA Compatibility. (#31635)

2026-01-08 09:00:07 +00:00

outputs.py

[Model] Reorganize pooling layers (#31973)

2026-01-09 11:02:14 +00:00

request.py

[Minor] Various small code cleanups/simplifications (#31508)

2025-12-29 22:42:06 -08:00

serial_utils.py

[Model] Move multimodal_cpu_fields definition to field config (#30181)

2025-12-06 13:40:02 +00:00

utils.py

[Feature] Add iteration level logging and enhance nvtx marker (#31193)

2026-01-09 00:13:39 +00:00