4 people bfdbfa1632 [Bugfix][PCP] Align MoE routing padding with gathered tokens (#60946) ...

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: wangyicong <wangyicong@bytedance.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>

2026-10-14 21:04:00 -04:00

..

cpu

[MRV2] Buffer util simplifications (#56888)

2026-09-15 20:36:51 +00:00

gpu

[Bugfix][PCP] Align MoE routing padding with gathered tokens (#60946)

2026-10-14 21:04:00 -04:00

sentinel

[Bugfix][FT] Pass stateless process-group timeouts explicitly (#58611)

2026-09-29 03:14:02 +00:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

cp_utils.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

cpu_model_runner.py

[Attention] Remove cascade attention (#61126)

2026-10-12 10:41:07 -07:00

cpu_worker.py

[Bugfix] Give each data-parallel engine its own global RNG streams (#59788)

2026-10-05 17:38:18 +00:00

dp_utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

ec_connector_model_runner_mixin.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

encoder_cudagraph_defs.py

[MM][CG] Enable encoder CUDA Graph for MiniCPM-V (#42785)

2026-09-10 06:28:48 +00:00

encoder_cudagraph.py

[Multimodal] Optimize encoder cudagraph padding logic (#58925)

2026-10-08 03:38:09 +00:00

gpu_input_batch.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

gpu_model_runner.py

[Spec Decode] Remove Medusa and MLP speculator support (#61701)

2026-10-14 17:29:23 -07:00

gpu_ubatch_wrapper.py

[Core] Model console logging as CLI configuration (#57205)

2026-09-25 11:36:59 +01:00

gpu_worker.py

[Bugfix] Share PCP-aware local GPU indexing for NUMA binding (#61237)

2026-10-14 10:54:03 +02:00

kv_connector_model_runner_mixin.py

[Bugfix][KVConnector] Finalize saves on steps without a forward (#57775)

2026-09-25 00:06:36 +00:00

lora_model_runner_mixin.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

mamba_utils.py

[Bugfix] Index Mamba align state copies by request slot in MRV2 (#60210)

2026-10-07 02:32:46 +00:00

mm_encoder_model_runner.py

[Bugfix][MRV2] Match fast-prefill padding to active LoRA batches (#56456)

2026-09-18 22:13:23 +00:00

startup_plan.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

ubatch_utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

ubatching.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

utils.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

worker_base.py

[Core] Add lifecycle hooks for worker extensions (#59463)

2026-10-13 21:51:05 +08:00

workspace.py

[Bugfix][MoE] Size the permute scratch from its inputs (#60447)

2026-10-08 15:32:07 -04:00

xpu_model_runner.py

[Attention] Remove cascade attention (#61126)

2026-10-12 10:41:07 -07:00

xpu_worker.py

[Refactor] Share workspace and model runner init between GPU and XPU workers (#59200)

2026-09-30 14:29:12 +00:00