5 people f1899b2ffd [Bugfix][ROCm] AITER MLA: size MTP verification decode metadata for real qlen/dtype (#45227) ...

Signed-off-by: Edwin Lim <edwin.lim@mangoboost.io>
Signed-off-by: Chaemin Lim <chaemin.lim@mangoboost.io>
Signed-off-by: QinPR <1905873179@qq.com>
Co-authored-by: Edwin Lim <edwin.lim@mangoboost.io>
Co-authored-by: limeward <32970461+edwinlim0919@users.noreply.github.com>
Co-authored-by: QinPR <1905873179@qq.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

2026-07-30 20:50:34 -05:00

..

attention

[Bugfix][ROCm] AITER MLA: size MTP verification decode metadata for real qlen/dtype (#45227)

2026-07-30 20:50:34 -05:00

core

[New model] Kimi K3 (#50000)

2026-07-30 03:49:58 -07:00

engine

feat(grpc): add KV event source discovery (#50033)

2026-07-29 13:46:40 -07:00

executor

[Bugfix] Prevent stale multiproc RPC deadlines from becoming unbounded waits (#41357)

2026-07-29 16:41:34 -07:00

fault_tolerance

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

kv_offload

[KV Offload] Move CPUOffloadingSpec onto SharedOffloadRegion (#50094)

2026-07-29 13:05:50 +03:00

metrics

[Front-end] [Messages] Populate num_cache_creation_tokens (#48535)

2026-07-18 13:04:35 -04:00

pool

[Core] Move MRV1 late_interaction_runner.py out of MRV2 subtree (#48014)

2026-07-08 18:30:11 +00:00

sample

Enable gfx1250 ROCm architecture (#46516)

2026-07-31 01:41:12 +00:00

simple_kv_offload

[Bugfix][KV Offload] Propagate EAGLE mode to SimpleCPU coordinator (#49071)

2026-07-20 06:39:11 +00:00

spec_decode

[New model] Kimi K3 (#50000)

2026-07-30 03:49:58 -07:00

structured_output

[Bugfix] Restore structured output logger initialization (#49626)

2026-07-23 11:26:03 -07:00

worker

[Model Runner V2][Spec Decode] Add multi-layer MTP speculator (#48892)

2026-07-30 15:54:15 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

kv_cache_interface.py

[New model] Kimi K3 (#50000)

2026-07-30 03:49:58 -07:00

kv_cache_spec_registry.py

[KVCache] Support Pluggable KVCacheSpec (#37505)

2026-06-03 09:05:16 -07:00

outputs.py

[MRV2][Spec Decode] Avoid rejection sampler OOM by chunking (#48630)

2026-07-23 18:13:13 +08:00

request.py

[BugFix] Fix num_output_placeholders preemption underflow (#48245)

2026-07-29 06:41:54 -07:00

serial_utils.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

utils.py

[Refactor] Move iteration logging to the frontend (#46647)

2026-07-15 17:59:05 -07:00