bugkeepandClaude 48aa8d8d75 [Bugfix] Prevent stale multiproc RPC deadlines from becoming unbounded waits (#41357) ...

Signed-off-by: bugkeep <1921817430@qq.com>
Co-authored-by: Claude <noreply@anthropic.com>

2026-07-29 16:41:34 -07:00

..

attention

[CPU] Fix FP8 attention scratchpad sizing (#50194)

2026-07-29 15:34:37 +08:00

core

feat(grpc): add KV event source discovery (#50033)

2026-07-29 13:46:40 -07:00

engine

feat(grpc): add KV event source discovery (#50033)

2026-07-29 13:46:40 -07:00

executor

[Bugfix] Prevent stale multiproc RPC deadlines from becoming unbounded waits (#41357)

2026-07-29 16:41:34 -07:00

fault_tolerance

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

kv_offload

[KV Offload] Move CPUOffloadingSpec onto SharedOffloadRegion (#50094)

2026-07-29 13:05:50 +03:00

metrics

[Front-end] [Messages] Populate num_cache_creation_tokens (#48535)

2026-07-18 13:04:35 -04:00

pool

[Core] Move MRV1 late_interaction_runner.py out of MRV2 subtree (#48014)

2026-07-08 18:30:11 +00:00

sample

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

simple_kv_offload

[Bugfix][KV Offload] Propagate EAGLE mode to SimpleCPU coordinator (#49071)

2026-07-20 06:39:11 +00:00

spec_decode

[BugFix] eagle draft max position embeddings (#49343)

2026-07-29 01:24:47 -07:00

structured_output

[Bugfix] Restore structured output logger initialization (#49626)

2026-07-23 11:26:03 -07:00

worker

[ModelRunner V2] Enable sequence pooling for embedding and classification models (#48791)

2026-07-29 06:30:45 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

kv_cache_interface.py

[Bugfix] Detect mixed precision in packed KV cache specs (#49623)

2026-07-23 20:07:06 -07:00

kv_cache_spec_registry.py

[KVCache] Support Pluggable KVCacheSpec (#37505)

2026-06-03 09:05:16 -07:00

outputs.py

[MRV2][Spec Decode] Avoid rejection sampler OOM by chunking (#48630)

2026-07-23 18:13:13 +08:00

request.py

[BugFix] Fix num_output_placeholders preemption underflow (#48245)

2026-07-29 06:41:54 -07:00

serial_utils.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

utils.py

[Refactor] Move iteration logging to the frontend (#46647)

2026-07-15 17:59:05 -07:00