3 people 2e3154aa18 [HiSparse] Log steady-state max concurrency and expose host-tier utilization gauges (#58949) ...

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

2026-10-05 14:20:32 -07:00

..

arch_overview.md

[Frontend] Move api_server.py out openai folder (#52131)

2026-08-19 09:43:46 +00:00

attention_backends.md

[Attention] Add Triton/FlashInfer composite for multimodal prefix attention (#56305)

2026-09-13 14:29:41 +00:00

cuda_graphs_multimodal.md

[MM][CG] Enable encoder CUDA Graph for MiniCPM-V (#42785)

2026-09-10 06:28:48 +00:00

cuda_graphs.md

[Spec Decode] Enable Gemma4 DSpark adaptive verification with FlashInfer (#57263)

2026-09-26 17:01:17 +08:00

custom_op.md

[Model] Remove Plamo2 (#49729)

2026-07-24 13:54:24 -07:00

dbo.md

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

debug_vllm_compile.md

[vLLM IR] 2/N fused_add_rms_norm and maybe_inplace overload (#36823)

2026-05-01 23:41:15 -04:00

endpoint_plugins.md

[Frontend] Move api_server.py out openai folder (#52131)

2026-08-19 09:43:46 +00:00

fused_moe_modular_kernel.md

[Bugfix][Doc] Fix references to FusedMoE in doc (#50701)

2026-08-02 09:13:06 +08:00

fusions.md

[Misc][Docs] Fix broken csrc kernel links in fusions doc (#47211)

2026-07-20 09:44:25 +00:00

hisparse.md

[HiSparse] Log steady-state max concurrency and expose host-tier utilization gauges (#58949)

2026-10-05 14:20:32 -07:00

huggingface_integration.md

[Frontend] Rework fastokens integration (#43168)

2026-05-21 15:36:58 -07:00

hybrid_kv_cache_manager.md

[Doc] Fix group numbering in Case 3 of hybrid_kv_cache_manager.md (#52160)

2026-08-19 11:38:34 +00:00

io_processor_plugins.md

add io_process_plugin for sparse embedding (#34214)

2026-02-28 09:16:37 +00:00

logits_processors.md

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

lora_resolver_plugins.md

[Docs] Update server entrypoint examples (#42077)

2026-05-09 02:03:52 +00:00

metrics.md

[Docs] Fix the typos in the document (#57190)

2026-09-17 15:52:10 +00:00

mm_processing.md

[Model] Extend device-side mm normalization to Kimi K2.5 / K3 (#59278)

2026-10-05 21:28:13 +08:00

model_runner_v2.md

[MRV2][Spec] Fuse AR speculator multi-step decodes back into one CUDA graph (#46849)

2026-08-11 15:06:22 +08:00

moe_kernel_features.md

[feat] FlashInfer CuteDSL MegaMoE integration (#54049)

2026-10-02 15:43:33 -04:00

multiprocessing.md

[Docs] Update design/multiprocessing.md (#30677)

2026-03-04 17:58:59 +00:00

nixl_kv_cache_lease.md

[NIXL] Avoid reading expired blocks in bidirectional turn-2 read (#47021)

2026-07-14 13:03:41 +00:00

nixl_kv_push_connector.md

[KVConnector][NIXL] Support packed MLA KV layouts in pipeline-parallel push prefill (#50499)

2026-09-28 18:50:46 +02:00

optimization_levels.md

[Docs] Update server entrypoint examples (#42077)

2026-05-09 02:03:52 +00:00

paged_attention.md

Chore: Fix minor doc sentence, grammar, quote errors (#40469)

2026-06-24 18:58:24 +00:00

plugin_system.md

[Frontend] Add endpoint plugins framework (#47454)

2026-07-08 10:00:41 +08:00

prefix_caching.md

[Doc] Fix typos, grammar, and broken commands across docs (#46398)

2026-06-23 02:01:22 +00:00

torch_compile_multimodal.md

[Doc] Fix multimodal torch.compile troubleshooting to not use removed VLLM_TORCH_COMPILE_LEVEL (#44378)

2026-06-07 00:34:07 -07:00

torch_compile.md

[Compile][CI] Honor Triton cache overrides and add AMD timeout headroom (#58474)

2026-09-24 01:27:07 -05:00

vllm_ir.md

[vLLM IR] 2/N fused_add_rms_norm and maybe_inplace overload (#36823)

2026-05-01 23:41:15 -04:00