3 people 8fe9317f2e [Model][MoE] DeepSeek-V4: add opt-in FlashInfer moe_ep expert backend (#49636) ...

Signed-off-by: Md Saidul Hoque Anik <mhoqueanik@nvidia.com>
Signed-off-by: Anerudhan Gopal <agopal@nvidia.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Anerudhan Gopal <agopal@nvidia.com>

2026-08-25 03:35:01 +00:00

..

__init__.py

[MoE Refactor] FusedMoE/MoERunner inversion refactor (#41184)

2026-06-08 10:42:58 -04:00

argparse_utils.py

[Bugfix][Core] Emit --no-{key} for false BooleanOptionalAction flags in YAML config (#51573)

2026-08-10 11:05:15 +00:00

async_utils.py

[Bugfix][Core] Close underlying iterator in merge_async_iterators single-iterator fast path (#44726)

2026-07-07 05:13:41 -07:00

b12x.py

[Kernel] Add b12x FP4 MoE backend (#52018)

2026-08-21 08:04:36 -07:00

cache.py

[Bugfix] Skip MM processor cache inserts larger than capacity (#53016)

2026-08-20 13:42:50 +00:00

collection_utils.py

[Plugin] Simplify IO Processor Plugin interface (#34236)

2026-02-10 19:47:39 -08:00

counter.py

[Misc] Separate out utils.counter and move utils.Device to engine (#27588)

2025-10-28 12:20:46 +00:00

cpu_resource_utils.py

[CPU] Create Proper Numa topology for s390x (#40714)

2026-07-13 12:58:43 +08:00

cpu_triton_utils.py

DCP supports hybrid attention (#40996)

2026-07-09 21:34:45 -07:00

deep_gemm.py

[Attention][DSA] Take the native decode path for MTP=3 on SM90 (#52164)

2026-08-14 10:09:51 +00:00

flashinfer_moe_ep.py

[Model][MoE] DeepSeek-V4: add opt-in FlashInfer moe_ep expert backend (#49636)

2026-08-25 03:35:01 +00:00

flashinfer.py

[Kernel] Add FlashInfer TRTLLM MXFP8 linear backend (#52204)

2026-08-20 10:07:22 -04:00

func_utils.py

[ROCm][Engine] Fix GPU memory leaks in engine shutdown and test workaround for async KV prefix cache reset (#38503)

2026-04-25 05:25:20 +00:00

gc_utils.py

[Doc]: fixing typos in multiple files. (#29685)

2025-11-28 08:41:41 -08:00

gpu_sync_debug.py

[Core] Make the GPU sync check thread-local and fix its suppressors (#51455)

2026-08-08 17:13:40 -07:00

hashing.py

[Core] Add xxHash as a high-performance hash option for accelerating prefix caching (#29163)

2025-12-03 16:06:57 +00:00

hpc.py

[MoE Backend] add HPC-Ops MoE backend (#45924)

2026-06-27 11:18:07 +08:00

humming.py

[Refactor] refactor humming linear and moe backends to use explicit layer configs (#49610)

2026-08-07 10:03:19 -07:00

import_utils.py

[ROCm] Defer tilelang import through its import from vllm.tilelang_utils import tilelang and relaxed has_tilelang (#51159)

2026-08-13 13:12:40 -05:00

jit_monitor.py

[ROCm] Defer tilelang import through its import from vllm.tilelang_utils import tilelang and relaxed has_tilelang (#51159)

2026-08-13 13:12:40 -05:00

jsontree.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

math_utils.py

[Refactor] Remove unused utils (#38153)

2026-03-26 17:08:19 +08:00

mem_constants.py

[Tests] Add Qwen3-VL multimodal memory leak check (#39268)

2026-04-09 04:54:46 -07:00

mem_utils.py

[copy of #45208] CuMem slept-L1 fragmentation accounting (#49208)

2026-07-20 23:08:11 +00:00

mistral.py

[PARSER][Mistral] unified engine-based parser for reasoning and tool calls (#48947)

2026-07-30 15:38:00 +02:00

multi_stream_utils.py

[Refactor] Remove multiple dead codes (#50285)

2026-08-03 10:59:08 -04:00

nccl.py

[WideEP] Update NCCL to 2.30.7 to enable DeepEPv2 in the vllm/vllm-openai image (#45321)

2026-07-24 13:00:02 -07:00

network_utils.py

[ROCm][Bugfix] Use TCP store when AITER custom all-reduce is enabled (#51635)

2026-08-10 11:07:14 +00:00

numa_utils.py

[Bugfix][Core] Fall back when numactl --membind is blocked in constrained containers (#45438)

2026-06-16 09:49:56 -07:00

numa_wrapper.sh

[CI] replace shellcheck script with shellcheck-py hook (#52572)

2026-08-20 10:09:59 +00:00

nvtx_pytorch_hooks.py

[Refactor] Remove dead code in multiple files (#49745)

2026-07-27 15:58:26 -04:00

ompmultiprocessing.py

[CPU] Create Proper Numa topology for s390x (#40714)

2026-07-13 12:58:43 +08:00

platform_utils.py

[CI/Build][BugFix][The Rock] Fix get_ssm_device_name to return sanitized, usable filename (#47781)

2026-07-08 12:12:54 +00:00

print_utils.py

[Examples][1/n] Resettle basic examples. (#35579)

2026-03-08 20:22:53 -07:00

registry.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

serial_utils.py

[Frontend] Add routed-experts prompt offset (#51906)

2026-08-13 08:09:00 -07:00

sparse_utils.py

[Bugfix][Security] Fix concurrent sparse invariant race bypassing CVE remediation (#48583)

2026-07-14 11:08:24 +00:00

system_utils.py

[UX] Reduce startup log noise (#50590)

2026-07-31 13:04:34 -07:00

tensor_schema.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

torch_utils.py

[6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718)

2026-08-21 17:47:49 -07:00

tqdm_utils.py

[Renderer] Move InputPreprocessor into Renderer (2/2) (#34560)

2026-02-17 05:29:01 -08:00