Cheng RuiandRui Rui4 Cheng 6664d397bf [Performance][MRV2] Cache logits-processing request state (#52329) ...

Signed-off-by: Rui Rui4 Cheng <chengrui4@lenovo.com>
Co-authored-by: Rui Rui4 Cheng <chengrui4@lenovo.com>

2026-08-17 02:36:41 +00:00

..

attention

[Config] Unify indexer cache dtype under attention_config.indexer_kv_dtype (#52550)

2026-08-17 10:20:04 +08:00

core

[Bugfix][V1][Multimodal] Ignore stale same-step encoder cache evictions (#52482)

2026-08-16 22:21:55 +00:00

engine

[EC Connector] Added Build Connector Worker Meta for EC Connector (#49585)

2026-08-15 15:40:38 -07:00

executor

[EC Connector] Added Build Connector Worker Meta for EC Connector (#49585)

2026-08-15 15:40:38 -07:00

fault_tolerance

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

kv_offload

[KV Offload] Expose data-parallel topology to offloading backends (#51879)

2026-08-12 20:27:26 -07:00

metrics

[Migration] Migrate bitsandbytes support to OOT plugin (#43529)

2026-08-09 10:27:31 +08:00

pool

[Core] Move MRV1 late_interaction_runner.py out of MRV2 subtree (#48014)

2026-07-08 18:30:11 +00:00

sample

[Bugfix][Sampling] Clear empty side on thinking-budget asymmetric SWAP (#49613)

2026-08-15 21:13:02 +00:00

simple_kv_offload

[Feat][Core] Add disk offloading support to SimpleCPUOffloadConnector (#49644)

2026-08-07 15:37:47 +08:00

spec_decode

Add Muse Glimmer model support (#51655)

2026-08-14 12:28:56 +08:00

structured_output

[Bugfix] Raise VLLMValidationError from structured output validators (#52394)

2026-08-16 01:04:51 -07:00

worker

[Performance][MRV2] Cache logits-processing request state (#52329)

2026-08-17 02:36:41 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

kv_cache_interface.py

[5/N][KV-Cache Layout Refactor] Backend-published KV packing via customize_spec (#51704)

2026-08-14 09:47:55 -04:00

kv_cache_spec_registry.py

[KVCache] Support Pluggable KVCacheSpec (#37505)

2026-06-03 09:05:16 -07:00

outputs.py

[EC Connector] Added Build Connector Worker Meta for EC Connector (#49585)

2026-08-15 15:40:38 -07:00

request.py

feat(frontend): session id plumbing into requests (#48048)

2026-08-03 22:18:58 +00:00

serial_utils.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

utils.py

[Rust Frontend][gRPC] Add explicit data-parallel rank routing (#51178)

2026-08-10 15:05:24 -07:00