Misha GoinandClaude e3a29aa9b3 [Bugfix][MoE] Size the permute scratch from its inputs (#60447) ...

Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>

2026-10-08 15:32:07 -04:00

..

cpu

[MRV2] Buffer util simplifications (#56888)

2026-09-15 20:36:51 +00:00

gpu

[Compile] Remove torch.compile-based sequence parallelism and AsyncTP (#60517)

2026-10-08 08:28:23 -07:00

sentinel

[Bugfix][FT] Pass stateless process-group timeouts explicitly (#58611)

2026-09-29 03:14:02 +00:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

cp_utils.py

[PCP][DCP] Support DCP target model with non-DCP Dspark (#56723)

2026-09-26 18:12:35 -04:00

cpu_model_runner.py

[Feature] Triton kernel dispatcher (#43048)

2026-09-25 04:07:43 +00:00

cpu_worker.py

[Bugfix] Give each data-parallel engine its own global RNG streams (#59788)

2026-10-05 17:38:18 +00:00

dp_utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

ec_connector_model_runner_mixin.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

encoder_cudagraph_defs.py

[MM][CG] Enable encoder CUDA Graph for MiniCPM-V (#42785)

2026-09-10 06:28:48 +00:00

encoder_cudagraph.py

[Multimodal] Optimize encoder cudagraph padding logic (#58925)

2026-10-08 03:38:09 +00:00

gpu_input_batch.py

[Bugfix] V1: clear stale allowed_token_ids mask in InputBatch.condense (#43931)

2026-09-27 03:44:54 +00:00

gpu_model_runner.py

[Compile] Remove torch.compile-based sequence parallelism and AsyncTP (#60517)

2026-10-08 08:28:23 -07:00

gpu_ubatch_wrapper.py

[Core] Model console logging as CLI configuration (#57205)

2026-09-25 11:36:59 +01:00

gpu_worker.py

[Bugfix][Prefix caching] Fix inconsistent hybrid Mamba prefix cache boundaries (#60533)

2026-10-08 18:33:48 +00:00

kv_connector_model_runner_mixin.py

[Bugfix][KVConnector] Finalize saves on steps without a forward (#57775)

2026-09-25 00:06:36 +00:00

lora_model_runner_mixin.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

mamba_utils.py

[Bugfix] Index Mamba align state copies by request slot in MRV2 (#60210)

2026-10-07 02:32:46 +00:00

mm_encoder_model_runner.py

[Bugfix][MRV2] Match fast-prefill padding to active LoRA batches (#56456)

2026-09-18 22:13:23 +00:00

startup_plan.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

ubatch_utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

ubatching.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

utils.py

[Compile] Remove torch.compile-based sequence parallelism and AsyncTP (#60517)

2026-10-08 08:28:23 -07:00

worker_base.py

[Bugfix][Pooling] Handle multimodal cache misses without crashing (#58975)

2026-10-02 10:14:33 -04:00

workspace.py

[Bugfix][MoE] Size the permute scratch from its inputs (#60447)

2026-10-08 15:32:07 -04:00

xpu_model_runner.py

[XPU] Use encoder-only model runner for EC producer instances (#59320)

2026-09-30 13:43:21 +08:00

xpu_worker.py

[Refactor] Share workspace and model runner init between GPU and XPU workers (#59200)

2026-09-30 14:29:12 +00:00