MOVZXandHinata 17c1c70447 [Spec Decode] Structured output under concurrency on a PP shape ...

Ports upstream vLLM PRs #54442 and #56802 (issue #54437): never sample from an
unmasked row, and key draft-token hand-off snapshots by scheduler step so an
alternating PP microbatch cannot overwrite the slot.

Co-Authored-By: Hinata <hinata@idihore.id>
Signed-off-by: MOVZX <movzx@yahoo.com>

2026-10-09 19:43:58 +07:00

..

__init__.py

[Feature] Add fixed-token prefill scoring (#54335)

2026-09-28 07:50:09 -07:00

admission_control.py

[Frontend] Share max_num_queued_reqs across API server processes (#54746)

2026-09-15 14:50:26 +00:00

async_llm.py

[Bugfix][Frontend] Avoid generation for empty streaming input (#59015)

2026-10-02 18:48:43 +00:00

coordinator.py

[Core] Model console logging as CLI configuration (#57205)

2026-09-25 11:36:59 +01:00

core_client.py

[Frontend][RL] Align sleep-mode API responses and operation metrics (#52864)

2026-09-29 23:16:38 -07:00

core.py

[Spec Decode] Structured output under concurrency on a PP shape

2026-10-09 19:43:58 +07:00

detokenizer.py

[Bugfix][Frontend] Seed derender detokenization from the prompt (#59046)

2026-10-02 03:17:56 +00:00

exceptions.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

input_processor.py

[Feature] Per-row candidate IDs for prefill token scoring (M2 of #56860) (#56984)

2026-10-03 14:17:09 +00:00

llm_engine.py

[Bugfix][Pooling] Handle multimodal cache misses without crashing (#58975)

2026-10-02 10:14:33 -04:00

logprobs.py

[Feature] Add fixed-token prefill scoring (#54335)

2026-09-28 07:50:09 -07:00

output_processor.py

[Bugfix][Pooling] Handle multimodal cache misses without crashing (#58975)

2026-10-02 10:14:33 -04:00

parallel_sampling.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

tensor_ipc.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

utils.py

[Bugfix] Fix stalled local-only Elastic EP scale-up (#57820)

2026-10-02 10:47:55 -04:00