6 people e19a3e172e [5/N] Share HiSparse host cache across TP ranks (reopens #52760) (#56629) ...

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Chao Lei <leichao139636@163.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Chao Lei <leichao139636@163.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>

2026-09-12 19:48:25 -04:00

..

arch_overview.md

[Frontend] Move api_server.py out openai folder (#52131)

2026-08-19 09:43:46 +00:00

attention_backends.md

[Kernel] Add B12X causal paged attention backend (#52017)

2026-09-01 10:42:02 -04:00

cuda_graphs_multimodal.md

[MM][CG] Enable encoder CUDA Graph for MiniCPM-V (#42785)

2026-09-10 06:28:48 +00:00

cuda_graphs.md

[Doc] Fix typos, grammar, and broken commands across docs (#46398)

2026-06-23 02:01:22 +00:00

custom_op.md

[Model] Remove Plamo2 (#49729)

2026-07-24 13:54:24 -07:00

dbo.md

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

debug_vllm_compile.md

[vLLM IR] 2/N fused_add_rms_norm and maybe_inplace overload (#36823)

2026-05-01 23:41:15 -04:00

endpoint_plugins.md

[Frontend] Move api_server.py out openai folder (#52131)

2026-08-19 09:43:46 +00:00

fused_moe_modular_kernel.md

[Bugfix][Doc] Fix references to FusedMoE in doc (#50701)

2026-08-02 09:13:06 +08:00

fusions.md

[Misc][Docs] Fix broken csrc kernel links in fusions doc (#47211)

2026-07-20 09:44:25 +00:00

hisparse.md

[5/N] Share HiSparse host cache across TP ranks (reopens #52760) (#56629)

2026-09-12 19:48:25 -04:00

huggingface_integration.md

[Frontend] Rework fastokens integration (#43168)

2026-05-21 15:36:58 -07:00

hybrid_kv_cache_manager.md

[Doc] Fix group numbering in Case 3 of hybrid_kv_cache_manager.md (#52160)

2026-08-19 11:38:34 +00:00

io_processor_plugins.md

add io_process_plugin for sparse embedding (#34214)

2026-02-28 09:16:37 +00:00

logits_processors.md

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

lora_resolver_plugins.md

[Docs] Update server entrypoint examples (#42077)

2026-05-09 02:03:52 +00:00

metrics.md

[Misc] Remove deprecated calculate_kv_scales runtime KV scale calculation (#49389)

2026-08-03 11:15:13 -04:00

mm_processing.md

[MM] Simplify _apply_hf_processor_main (#53275)

2026-08-22 01:49:37 -07:00

model_runner_v2.md

[MRV2][Spec] Fuse AR speculator multi-step decodes back into one CUDA graph (#46849)

2026-08-11 15:06:22 +08:00

moe_kernel_features.md

[MoE] Refine FlashInfer one-sided All2All integration (#51924)

2026-08-18 00:18:14 +00:00

multiprocessing.md

[Docs] Update design/multiprocessing.md (#30677)

2026-03-04 17:58:59 +00:00

nixl_kv_cache_lease.md

[NIXL] Avoid reading expired blocks in bidirectional turn-2 read (#47021)

2026-07-14 13:03:41 +00:00

nixl_kv_push_connector.md

[PD][NixlPush][Bugfix] Fix blocking handshake call on writer thread (#49221)

2026-07-24 01:41:37 -07:00

optimization_levels.md

[Docs] Update server entrypoint examples (#42077)

2026-05-09 02:03:52 +00:00

paged_attention.md

Chore: Fix minor doc sentence, grammar, quote errors (#40469)

2026-06-24 18:58:24 +00:00

plugin_system.md

[Frontend] Add endpoint plugins framework (#47454)

2026-07-08 10:00:41 +08:00

prefix_caching.md

[Doc] Fix typos, grammar, and broken commands across docs (#46398)

2026-06-23 02:01:22 +00:00

torch_compile_multimodal.md

[Doc] Fix multimodal torch.compile troubleshooting to not use removed VLLM_TORCH_COMPILE_LEVEL (#44378)

2026-06-07 00:34:07 -07:00

torch_compile.md

[Frontend] Remap -O to -cc commandline flag (#29557)

2025-11-28 21:51:12 +00:00

vllm_ir.md

[vLLM IR] 2/N fused_add_rms_norm and maybe_inplace overload (#36823)

2026-05-01 23:41:15 -04:00