wang.yuqiandCyrus Leung 2fa490470d [Model] Fused mm preprocess normalisation on the Device (#50411) ...

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

2026-08-06 03:11:14 -07:00

..

arch_overview.md

[Misc] Move the legacy api_server.py to the examples directory. (#46783)

2026-06-26 07:43:29 +00:00

attention_backends.md

[Attention] Integrate FlashAttention 4 SM100 headdim 256 support (#42669)

2026-07-27 18:25:50 +00:00

cuda_graphs_multimodal.md

[MM][CG] Support ViT full CUDA graph for Ernie-4.5-VL image inference (#45254)

2026-08-06 05:04:19 +00:00

cuda_graphs.md

[Doc] Fix typos, grammar, and broken commands across docs (#46398)

2026-06-23 02:01:22 +00:00

custom_op.md

[Model] Remove Plamo2 (#49729)

2026-07-24 13:54:24 -07:00

dbo.md

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

debug_vllm_compile.md

[vLLM IR] 2/N fused_add_rms_norm and maybe_inplace overload (#36823)

2026-05-01 23:41:15 -04:00

endpoint_plugins.md

[Frontend] Add endpoint plugins framework (#47454)

2026-07-08 10:00:41 +08:00

fused_moe_modular_kernel.md

[Bugfix][Doc] Fix references to FusedMoE in doc (#50701)

2026-08-02 09:13:06 +08:00

fusions.md

[Misc][Docs] Fix broken csrc kernel links in fusions doc (#47211)

2026-07-20 09:44:25 +00:00

huggingface_integration.md

[Frontend] Rework fastokens integration (#43168)

2026-05-21 15:36:58 -07:00

hybrid_kv_cache_manager.md

Chore: Fix minor doc sentence, grammar, quote errors (#40469)

2026-06-24 18:58:24 +00:00

io_processor_plugins.md

add io_process_plugin for sparse embedding (#34214)

2026-02-28 09:16:37 +00:00

logits_processors.md

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

lora_resolver_plugins.md

[Docs] Update server entrypoint examples (#42077)

2026-05-09 02:03:52 +00:00

metrics.md

[Misc] Remove deprecated calculate_kv_scales runtime KV scale calculation (#49389)

2026-08-03 11:15:13 -04:00

mm_processing.md

[Model] Fused mm preprocess normalisation on the Device (#50411)

2026-08-06 03:11:14 -07:00

model_runner_v2.md

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

moe_kernel_features.md

[Docs] Fix two docs build warnings (#51014)

2026-08-04 05:29:04 -07:00

multiprocessing.md

[Docs] Update design/multiprocessing.md (#30677)

2026-03-04 17:58:59 +00:00

nixl_kv_cache_lease.md

[NIXL] Avoid reading expired blocks in bidirectional turn-2 read (#47021)

2026-07-14 13:03:41 +00:00

nixl_kv_push_connector.md

[PD][NixlPush][Bugfix] Fix blocking handshake call on writer thread (#49221)

2026-07-24 01:41:37 -07:00

optimization_levels.md

[Docs] Update server entrypoint examples (#42077)

2026-05-09 02:03:52 +00:00

paged_attention.md

Chore: Fix minor doc sentence, grammar, quote errors (#40469)

2026-06-24 18:58:24 +00:00

plugin_system.md

[Frontend] Add endpoint plugins framework (#47454)

2026-07-08 10:00:41 +08:00

prefix_caching.md

[Doc] Fix typos, grammar, and broken commands across docs (#46398)

2026-06-23 02:01:22 +00:00

torch_compile_multimodal.md

[Doc] Fix multimodal torch.compile troubleshooting to not use removed VLLM_TORCH_COMPILE_LEVEL (#44378)

2026-06-07 00:34:07 -07:00

torch_compile.md

[Frontend] Remap -O to -cc commandline flag (#29557)

2025-11-28 21:51:12 +00:00

vllm_ir.md

[vLLM IR] 2/N fused_add_rms_norm and maybe_inplace overload (#36823)

2026-05-01 23:41:15 -04:00