5 people 6491f481a7 [Bugfix] Stop allocator fragmentation from shrinking the KV cache during memory profiling (#58430) ...

Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Signed-off-by: Robert Shaw <robertgshaw2-redhat@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Robert Shaw <robertgshaw2-redhat@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>

2026-09-25 12:16:27 -04:00

..

cpu

[MRV2] Buffer util simplifications (#56888)

2026-09-15 20:36:51 +00:00

gpu

[MRV2] Minor model_runner.py code cleanup (#58610)

2026-09-25 07:59:27 -07:00

sentinel

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

cp_utils.py

[PCP][Spec Decode] Adds PCP support for single-module MTP and replicated DSpark. (#56107)

2026-09-10 22:07:53 -07:00

cpu_model_runner.py

[Feature] Triton kernel dispatcher (#43048)

2026-09-25 04:07:43 +00:00

cpu_worker.py

[Profiler] Unify platform-aware torch profiling (#57460)

2026-09-20 19:17:23 -07:00

dp_utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

ec_connector_model_runner_mixin.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

encoder_cudagraph_defs.py

[MM][CG] Enable encoder CUDA Graph for MiniCPM-V (#42785)

2026-09-10 06:28:48 +00:00

encoder_cudagraph.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

gpu_input_batch.py

Release prompt_embeds tensor when its InputBatch slot is freed (#57988)

2026-09-25 00:00:44 +00:00

gpu_model_runner.py

[MM] Move supports_multimodal_inputs and cache out of registry (#57913)

2026-09-21 07:43:07 -07:00

gpu_ubatch_wrapper.py

[Core] Model console logging as CLI configuration (#57205)

2026-09-25 11:36:59 +01:00

gpu_worker.py

[Bugfix] Stop allocator fragmentation from shrinking the KV cache during memory profiling (#58430)

2026-09-25 12:16:27 -04:00

kv_connector_model_runner_mixin.py

[Bugfix][KVConnector] Finalize saves on steps without a forward (#57775)

2026-09-25 00:06:36 +00:00

lora_model_runner_mixin.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

mamba_utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

mm_encoder_model_runner.py

[Bugfix][MRV2] Match fast-prefill padding to active LoRA batches (#56456)

2026-09-18 22:13:23 +00:00

startup_plan.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

ubatch_utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

ubatching.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

utils.py

[ROCm][CI] Mirror the DSv4-Flash disaggregated DP EP group on MI355 (#58558)

2026-09-24 18:38:25 -05:00

worker_base.py

[Feature] Triton kernel dispatcher (#43048)

2026-09-25 04:07:43 +00:00

workspace.py

[Core][Kernel] Share persistent workspaces for Marlin and Humming (#57421)

2026-09-20 17:28:33 +08:00

xpu_model_runner.py

[XPU] Alias is_current_stream_capturing to XPU in cuda wrapper (#50526)

2026-08-05 15:10:17 +08:00

xpu_worker.py

[Profiler] Unify platform-aware torch profiling (#57460)

2026-09-20 19:17:23 -07:00