vLLM/csrc at 76df77c04ecb0dca880b4f425c9d5f10a396a025 - vLLM

attention

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

core

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

cpu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

cutlass_extensions

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

gdn

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

kimi_k3

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

libtorch_stable

Merge branch 'main' into patches

2026-10-15 21:16:39 +07:00

mamba

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

moe

[Kernel] Fuse DeepEP-v2 decode globalize+align into one launch (#53911 )

2026-10-13 11:10:38 -04:00

quantization

[GLM 5.3 Perf] Handle two elements at the same time for per token group quant, 2.8% E2E ITL improvement (#60927 )

2026-10-13 13:06:41 -07:00

rocm

[ROCm][Perf] W4A16: speed up skinny GEMM decode, including speculative batches (#57199 )

2026-10-13 17:21:30 +00:00

activation_kernels.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

async_util.cuh

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

cache_kernels_fused.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

cache_kernels.cu

[Kernel][Build] Bump DeepGEMM to the 26/09/30 release and adapt the sparse indexer (#61149 )

2026-10-12 23:24:43 -07:00

concat_mla_q.cuh

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

cooperative_topk.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

cooperative_topk.cuh

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

cub_helpers.h

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

cuda_utils_kernels.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

cuda_utils.h

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

cuda_vec_utils.cuh

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

cuda_view.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

cumem_allocator_compat.h

[Core][AMD] Migrate fully transparent sleep mode to ROCm platform (#12695 )

2025-11-12 15:24:12 -08:00

cumem_allocator.cpp

[ROCm] Enable the cuMem CUDA-graph pool offload on ROCm (#59523 )

2026-10-09 08:29:55 +00:00

custom_all_gather_reduce_scatter_ops.cpp

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

custom_all_gather_reduce_scatter.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

custom_all_gather_reduce_scatter.cuh

[Perf][Distributed] Add low-SM multimem reduce-scatter for SM100/SM103 (#55072 )

2026-09-25 03:27:21 +00:00

custom_all_reduce.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

custom_all_reduce.cuh

[Perf][Distributed] Add low-SM multimem reduce-scatter for SM100/SM103 (#55072 )

2026-09-25 03:27:21 +00:00

custom_collective_common.cuh

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

dispatch_utils.h

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

dsv3_fused_a_gemm.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

flashkda_registration.cpp

[Perf] Support internal prefill checkpoints for Mamba prefix caching, 9%~25% TTFT improvement (#52789 )

2026-08-22 10:32:40 -07:00

fp32_router_gemm_entry.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

fp32_router_gemm.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

fs_io.cpp

[KV Offload] Fix failed-load livelock by marking the lookup verdict as a miss (#49328 )

2026-08-09 10:25:36 +03:00

fused_deepseek_v4_qnorm_rope_kv_insert_kernel.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

fused_kimi_k3_mla_key_concat_kv_cache_kernel.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

fused_minimax_m3_qknorm_rope_kv_insert_kernel.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

fused_qknorm_rope_kernel.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

hisparse_kernels.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

launch_bounds_utils.h

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

layernorm_kernels.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

layernorm_quant_kernels.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

minimax_reduce_rms_kernel.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

minimax_reduce_rms_kernel.h

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

ngram_embedding_kernels.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

nvfp4_ds_mla_cache_kernels.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

nvfp4_ds_mla_cache.h

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

nvfp4_kv_cache_kernels.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

ops.h

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

persistent_topk.cuh

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

pos_encoding_kernels.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

qutlass_registration.cpp

[12/n] final _C library kernel migration (#45415 )

2026-06-19 06:57:26 -07:00

sampled_topk.cuh

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

sampler.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

spinloop.cpp

[BugFix] Fix clang spinloop mwaitx include (#45532 )

2026-07-28 19:00:06 +00:00

topk_histogram_4096.cuh

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

topk.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

torch_bindings.cpp

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

torch_utils.h

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

type_convert.cuh

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00

vocab_parallel_embedding_kernels.cu

[Misc] Consolidate csrc shared headers and prune dead code (#60721 )

2026-10-12 09:46:22 -07:00