Nick Hill 50aa830482 [BugFix][MRV2] Don't create dummy requests longer than max_model_len (#49751) ...

Signed-off-by: Nick Hill <nickhill123@gmail.com>

2026-07-27 02:04:20 +00:00

..

attention

[Bugfix] Prevent NaN poisoning in xpu_mla_sparse for fully-masked index chunks (#48366)

2026-07-27 09:06:07 +08:00

core

[Perf][V1] Skip LRU hash-split in free_blocks when prefix caching is off (#48017)

2026-07-25 09:06:20 +00:00

engine

[Core][Distributed] Add process-checkpoint lifecycle hooks for communicators (starting with Flashinfer) (#46877)

2026-07-26 14:47:50 -04:00

executor

[CI/Build][The Rock][BugFix] Use fork method in test_multiproc_executor_multi_node for py 3.14 compat and fix test_multiproc_executor_shutdown_cleanup (#48655)

2026-07-21 15:40:29 -05:00

fault_tolerance

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

kv_offload

[KVOffload][P2P] Generic P2P secondary tier: peer lookup and serving via ParentManager (#48021)

2026-07-26 11:45:47 +03:00

metrics

[Front-end] [Messages] Populate num_cache_creation_tokens (#48535)

2026-07-18 13:04:35 -04:00

pool

[Core] Move MRV1 late_interaction_runner.py out of MRV2 subtree (#48014)

2026-07-08 18:30:11 +00:00

sample

[MRV2][Spec Decode] Avoid rejection sampler OOM by chunking (#48630)

2026-07-23 18:13:13 +08:00

simple_kv_offload

[Bugfix][KV Offload] Propagate EAGLE mode to SimpleCPU coordinator (#49071)

2026-07-20 06:39:11 +00:00

spec_decode

Revert "[Perf][GLM-5.2] Blackwell decode optimizations" (#49768)

2026-07-24 16:04:59 -07:00

structured_output

[Bugfix] Restore structured output logger initialization (#49626)

2026-07-23 11:26:03 -07:00

worker

[BugFix][MRV2] Don't create dummy requests longer than max_model_len (#49751)

2026-07-27 02:04:20 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

kv_cache_interface.py

[Bugfix] Detect mixed precision in packed KV cache specs (#49623)

2026-07-23 20:07:06 -07:00

kv_cache_spec_registry.py

[KVCache] Support Pluggable KVCacheSpec (#37505)

2026-06-03 09:05:16 -07:00

outputs.py

[MRV2][Spec Decode] Avoid rejection sampler OOM by chunking (#48630)

2026-07-23 18:13:13 +08:00

request.py

[Core] Preserve Marconi caching with selective hybrid cache retention (#47782)

2026-07-13 21:24:20 +01:00

serial_utils.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

utils.py

[Refactor] Move iteration logging to the frontend (#46647)

2026-07-15 17:59:05 -07:00