Wentao Ye f70caef48b [Perf] Cache token_to_req_indices for dsv4, 5x~6x kernel performance improvement (#47474) ...

Signed-off-by: yewentao256 <zhyanwentao@126.com>

2026-07-06 11:17:46 -04:00

..

attention

[Perf] Cache token_to_req_indices for dsv4, 5x~6x kernel performance improvement (#47474)

2026-07-06 11:17:46 -04:00

core

[Bugfix][Core] Fix num_output_placeholders underflow with async scheduling + spec decode (#46066)

2026-07-06 13:50:38 +00:00

engine

[Core][DP] Rotate load-balancer tie-break to avoid systematic engine bias (#47420)

2026-07-06 07:09:16 +00:00

executor

[Feature] Detect all2all peer fault with fault tolerance backend and prevent corrupted output (#43637)

2026-06-30 09:00:25 -07:00

kv_offload

[KV Offload] Pass ScheduleEndContext to on_schedule_end hook (#46450)

2026-06-30 17:07:12 +03:00

metrics

[Migration] Migrate GGUF quantization support to plugin (#39612)

2026-06-12 12:02:21 -07:00

pool

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

sample

[Bugfix][Reasoning] Fix thinking_token_budget not enforced on re-entry after forced end (#43757)

2026-06-30 01:04:25 +00:00

simple_kv_offload

[SimpleCPUOffloadConnector] Fix remaining global→block conversions under PCP/DCP (#46394)

2026-06-24 23:05:24 -07:00

spec_decode

Revert "[Platform] Replace torch.cuda.Event with torch.Event (#47140)" (#47668)

2026-07-06 14:18:33 +01:00

structured_output

[Bugfix][Structured Output][Spec Decode] Constrain bitmask and trim grammar advance at the reasoning boundary (#44297)

2026-07-04 09:08:45 +00:00

worker

Revert "[Platform] Replace torch.cuda.Event with torch.Event (#47140)" (#47668)

2026-07-06 14:18:33 +01:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

kv_cache_interface.py

[Model] Support Unlimited OCR (#46564)

2026-06-27 23:09:18 -07:00

kv_cache_spec_registry.py

[KVCache] Support Pluggable KVCacheSpec (#37505)

2026-06-03 09:05:16 -07:00

outputs.py

[Core] Cleanup KVConnector handling with PP + fix MRV2 (#43732)

2026-05-28 13:12:03 -07:00

request.py

[Bugfix] Defer block freeing until in-flight steps finish under async scheduling + PD KV consumer (#45357)

2026-06-15 21:36:09 +00:00

serial_utils.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

utils.py

Fix Transformers modeling backend usage stats (#47472)

2026-07-02 12:51:23 -07:00