5 people 31e90ac370 [Attention] Enable FA4 sparse MQA decode on Blackwell (#55866) ...

Signed-off-by: Simon Veitner <sveitner@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

2026-10-13 09:31:37 -04:00

..

arch_overview.md

[Frontend] Move api_server.py out openai folder (#52131)

2026-08-19 09:43:46 +00:00

attention_backends.md

[Attention] Enable FA4 sparse MQA decode on Blackwell (#55866)

2026-10-13 09:31:37 -04:00

cuda_graphs_multimodal.md

[Doc] Update ViT CUDA graph design doc (#60519)

2026-10-08 14:00:58 +08:00

cuda_graphs.md

[Attention] Remove cascade attention (#61126)

2026-10-12 10:41:07 -07:00

custom_op.md

[Model] Remove Plamo2 (#49729)

2026-07-24 13:54:24 -07:00

dbo.md

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

debug_vllm_compile.md

[Bugfix] Respect Inductor deterministic mode in combo-kernel defaults (#59074)

2026-10-07 20:08:11 +01:00

endpoint_plugins.md

[Bugfix][Frontend] Honor endpoint plugin route overrides (#58839)

2026-10-12 03:58:15 +00:00

expert_substitution.md

Add MoNe experts pruning support (#50415)

2026-10-12 23:18:43 +00:00

fused_moe_modular_kernel.md

[Bugfix][Doc] Fix references to FusedMoE in doc (#50701)

2026-08-02 09:13:06 +08:00

fusions.md

[Misc] Consolidate csrc shared headers and prune dead code (#60721)

2026-10-12 09:46:22 -07:00

hisparse.md

[HiSparse] Log steady-state max concurrency and expose host-tier utilization gauges (#58949)

2026-10-05 14:20:32 -07:00

huggingface_integration.md

[Frontend] Rework fastokens integration (#43168)

2026-05-21 15:36:58 -07:00

hybrid_kv_cache_manager.md

[Core][Mamba] Remove leftovers of mamba_cache_mode="all" (#60043)

2026-10-13 00:58:59 -07:00

io_processor_plugins.md

add io_process_plugin for sparse embedding (#34214)

2026-02-28 09:16:37 +00:00

logits_processors.md

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

lora_resolver_plugins.md

[Docs] Update server entrypoint examples (#42077)

2026-05-09 02:03:52 +00:00

metrics.md

[Metrics] Add admission rejection metrics (#55812)

2026-10-12 08:31:07 +00:00

mm_processing.md

[Model] Extend device-side mm normalization to Kimi K2.5 / K3 (#59278)

2026-10-05 21:28:13 +08:00

model_runner_v2.md

[MRV2][Spec] Fuse AR speculator multi-step decodes back into one CUDA graph (#46849)

2026-08-11 15:06:22 +08:00

moe_kernel_features.md

[ROCm][MoE] Split AiterExperts by weight-quantization key (#60322)

2026-10-13 00:13:33 -05:00

multiprocessing.md

[Docs] Update design/multiprocessing.md (#30677)

2026-03-04 17:58:59 +00:00

nixl_kv_cache_lease.md

[NIXL] Avoid reading expired blocks in bidirectional turn-2 read (#47021)

2026-07-14 13:03:41 +00:00

nixl_kv_push_connector.md

[KVConnector][NIXL] Support packed MLA KV layouts in pipeline-parallel push prefill (#50499)

2026-09-28 18:50:46 +02:00

optimization_levels.md

[Docs] Update server entrypoint examples (#42077)

2026-05-09 02:03:52 +00:00

paged_attention.md

Chore: Fix minor doc sentence, grammar, quote errors (#40469)

2026-06-24 18:58:24 +00:00

plugin_system.md

[Frontend] Add endpoint plugins framework (#47454)

2026-07-08 10:00:41 +08:00

prefix_caching.md

[Doc] Fix typos, grammar, and broken commands across docs (#46398)

2026-06-23 02:01:22 +00:00

shm_tensor_arena.md

[Core] shm tensor arena for efficient cpu->gpu worker broadcast (#51207)

2026-10-09 16:13:24 -07:00

torch_compile_multimodal.md

[Doc] Fix multimodal torch.compile troubleshooting to not use removed VLLM_TORCH_COMPILE_LEVEL (#44378)

2026-06-07 00:34:07 -07:00

torch_compile.md

[Compile][CI] Honor Triton cache overrides and add AMD timeout headroom (#58474)

2026-09-24 01:27:07 -05:00

vllm_ir.md

[Compile] Remove torch.compile-based sequence parallelism and AsyncTP (#60517)

2026-10-08 08:28:23 -07:00