3 people 560ef78bfe [Perf][Model Runner V2] Compact sampling masks on GPU instead of unpacking the full-vocab bitmask on CPU (#54901) ...

Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: vx120 <893600387@qq.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: vx120 <893600387@qq.com>

2026-09-03 19:03:36 -07:00

..

__init__.py

[Frontend][Core][Spec Decode] Per-request acceptance stats in OpenAI API responses (#48915)

2026-08-20 15:42:49 -07:00

async_llm.py

[warmup] overlap renderer warmup and engine core initialization (#54557)

2026-09-03 19:44:21 +00:00

coordinator.py

[Bugfix][DP] Don't assume the engines started when forwarding a wake (#51481)

2026-08-18 13:49:35 -07:00

core_client.py

[warmup] overlap renderer warmup and engine core initialization (#54557)

2026-09-03 19:44:21 +00:00

core.py

[Model] add GLM-5.3-Flash support (#53906)

2026-09-03 09:40:35 -07:00

detokenizer.py

[Bugfix][Spec Decode] Select earliest-completing stop string in check_stop_strings (#49391)

2026-07-23 18:14:06 +08:00

exceptions.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

input_processor.py

(security) fix: enforce decoder prompt-length validation for skip-che… (#46588)

2026-08-21 09:07:19 -07:00

llm_engine.py

[warmup] overlap renderer warmup and engine core initialization (#54557)

2026-09-03 19:44:21 +00:00

logprobs.py

[Feature][DSpark]: Logprobs adaptive verification (#52242)

2026-08-25 10:22:33 -04:00

output_processor.py

[Perf][Model Runner V2] Compact sampling masks on GPU instead of unpacking the full-vocab bitmask on CPU (#54901)

2026-09-03 19:03:36 -07:00

parallel_sampling.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

tensor_ipc.py

Add tensor IPC transfer mechanism for multimodal data (#32104)

2026-03-21 20:10:20 +00:00

utils.py

[ROCm] Give EngineCore cleanup grace after request abort (#52281)

2026-08-19 11:39:59 -05:00