Wentao Ye 626c90b2d5 [Refactor] Move fla to third party (#48500) ...

Signed-off-by: yewentao256 <zhyanwentao@126.com>

2026-07-16 19:22:36 +01:00

..

attention

[Refactor] Move fla to third party (#48500)

2026-07-16 19:22:36 +01:00

core

[KV Connector] Fix PD async scheduling race condition for hybrid attn models (#48481)

2026-07-16 11:42:37 +01:00

engine

[Refactor] Move iteration logging to the frontend (#46647)

2026-07-15 17:59:05 -07:00

executor

[UX] Log worker exit code when process dies unexpectedly (#38641)

2026-07-07 12:36:29 +00:00

kv_offload

[KV Offload] Split tiering_lookup_delay into sync/async histograms (#47679)

2026-07-16 20:03:45 +03:00

metrics

[Refactor] Move iteration logging to the frontend (#46647)

2026-07-15 17:59:05 -07:00

pool

[Core] Move MRV1 late_interaction_runner.py out of MRV2 subtree (#48014)

2026-07-08 18:30:11 +00:00

sample

[Reasoning] Optimize TPOT for thinking budget when used with speculative decoding (#46662)

2026-07-14 18:55:40 +00:00

simple_kv_offload

[Core] Preserve Marconi caching with selective hybrid cache retention (#47782)

2026-07-13 21:24:20 +01:00

spec_decode

[Spec Decode] Add kv_cache_dtype to speculative_config to control separately from target (#48787)

2026-07-15 23:49:23 -06:00

structured_output

[Security] Replace diskcache to eliminate pickle deserialization (#44549)

2026-07-14 20:29:24 -07:00

worker

[Model] Add PW CUDA graph support for Inkling [2/N] (#48822)

2026-07-16 10:28:56 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

kv_cache_interface.py

[Bugfix] Include inline per-token-head scales in offloaded page transfer width (#48411)

2026-07-14 16:07:26 +03:00

kv_cache_spec_registry.py

[KVCache] Support Pluggable KVCacheSpec (#37505)

2026-06-03 09:05:16 -07:00

outputs.py

[Core] Cleanup KVConnector handling with PP + fix MRV2 (#43732)

2026-05-28 13:12:03 -07:00

request.py

[Core] Preserve Marconi caching with selective hybrid cache retention (#47782)

2026-07-13 21:24:20 +01:00

serial_utils.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

utils.py

[Refactor] Move iteration logging to the frontend (#46647)

2026-07-15 17:59:05 -07:00