5 people 819852df6b [ModelRunner V2] Speculative Decoding NGram GPU Implementations (#40704) ...

Signed-off-by: PatchouliTaisa <patchychen@tencent.com>
Signed-off-by: PatchouliTaisa <pyramkar@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Xuanan Chen <xuananchenc@nvidia.com>
Co-authored-by: PatchouliTaisa <patchychen@tencent.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Xuanan Chen <xuananchenc@nvidia.com>
Co-authored-by: Giancarlo Delfin <32987265+TheEpicDolphin@users.noreply.github.com>

2026-10-06 13:32:59 -07:00

..

passes

[ROCm] Fuse MLA dual RMSNorm + FP8 group quant for DeepSeek-R1 (#54857)

2026-10-06 11:26:38 -05:00

__init__.py

[torch.compile] avoid Dynamo guard evaluation overhead (#7898)

2024-08-28 16:10:12 -07:00

backends.py

[ModelRunner V2] Speculative Decoding NGram GPU Implementations (#40704)

2026-10-06 13:32:59 -07:00

base_static_graph.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

breakable_cudagraph.py

[Feature] Release the CUDA graph pool on sleep (#59160)

2026-10-04 01:13:10 +00:00

caching.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

codegen.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

compiler_interface.py

[Bugfix] Fix standalone torch.compile cache loading after relocation (#52142)

2026-09-29 12:53:20 -04:00

counter.py

[compile] aot_compile should respect VLLM_DISABLE_COMPILE_CACHE (#36358)

2026-03-11 03:12:03 -07:00

cuda_graph.py

[Feature] Release the CUDA graph pool on sleep (#59160)

2026-10-04 01:13:10 +00:00

cudagraph_pool.py

[Feature] Release the CUDA graph pool on sleep (#59160)

2026-10-04 01:13:10 +00:00

decorators.py

[UX] Tag torch.compile log lines with the component being compiled (#48133)

2026-09-30 10:34:31 +00:00

monitor.py

[UX] Tag torch.compile log lines with the component being compiled (#48133)

2026-09-30 10:34:31 +00:00

partition_rules.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

piecewise_backend.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

wrapper.py

[MRV2] Support stock torch.compile mode (#59079)

2026-09-28 20:17:48 -07:00