vLLM/vllm/utils at d552a68645b60fe194ed488e9c3df211e4d2fa6f - vLLM

__init__.py

[MoE Refactor] FusedMoE/MoERunner inversion refactor (#41184 )

2026-06-08 10:42:58 -04:00

argparse_utils.py

[Misc] Support Human-readable (k/K/m/M..) json cli arg (#40473 )

2026-04-23 09:42:23 +02:00

async_utils.py

[Bugfix][Core] Close underlying iterator in merge_async_iterators single-iterator fast path (#44726 )

2026-07-07 05:13:41 -07:00

cache.py

fix: prevent MM cache hang from stale LRU order keys (#43595 )

2026-06-08 22:48:31 -07:00

collection_utils.py

[Plugin] Simplify IO Processor Plugin interface (#34236 )

2026-02-10 19:47:39 -08:00

counter.py

[Misc] Separate out utils.counter and move utils.Device to engine (#27588 )

2025-10-28 12:20:46 +00:00

cpu_resource_utils.py

[CPU] Create Proper Numa topology for s390x (#40714 )

2026-07-13 12:58:43 +08:00

cpu_triton_utils.py

DCP supports hybrid attention (#40996 )

2026-07-09 21:34:45 -07:00

deep_gemm.py

Enable DeepSeek V4 and GLM-5.1 on SM120 (#43477 )

2026-06-22 11:54:14 -07:00

flashinfer.py

[Performance] Use CuTe-DSL for FlashInfer MXFP4 quantization (#48417 )

2026-07-17 06:53:48 -07:00

func_utils.py

[ROCm][Engine] Fix GPU memory leaks in engine shutdown and test workaround for async KV prefix cache reset (#38503 )

2026-04-25 05:25:20 +00:00

gc_utils.py

[Doc]: fixing typos in multiple files. (#29685 )

2025-11-28 08:41:41 -08:00

gpu_sync_debug.py

[Core] Add VLLM_GPU_SYNC_CHECK env var (#44800 )

2026-06-26 08:24:33 -07:00

hashing.py

[Core] Add xxHash as a high-performance hash option for accelerating prefix caching (#29163 )

2025-12-03 16:06:57 +00:00

hpc.py

[MoE Backend] add HPC-Ops MoE backend (#45924 )

2026-06-27 11:18:07 +08:00

humming.py

[MoE Refactor] Standardize Humming MoE experts + utilities (#43373 )

2026-06-29 06:19:29 -07:00

import_utils.py

[Bugfix] Avoid blocking model launching when no system ffmpeg available for TorchCodec (#47888 )

2026-07-08 10:52:25 +08:00

jit_monitor.py

Bump flashinfer version to 0.6.14 (#47669 )

2026-07-15 21:00:40 -07:00

jsontree.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666 )

2025-11-28 20:40:47 +08:00

math_utils.py

[Refactor] Remove unused utils (#38153 )

2026-03-26 17:08:19 +08:00

mem_constants.py

[Tests] Add Qwen3-VL multimodal memory leak check (#39268 )

2026-04-09 04:54:46 -07:00

mem_utils.py

[copy of #45208 ] CuMem slept-L1 fragmentation accounting (#49208 )

2026-07-20 23:08:11 +00:00

mistral.py

[Feature] Avoid eager import of the "mistral_common" package. (#40043 )

2026-04-24 02:49:16 +00:00

multi_stream_utils.py

Revert "[Platform] Replace torch.cuda.Event with torch.Event (#47140 )" (#47668 )

2026-07-06 14:18:33 +01:00

nccl.py

[WideEP] Update NCCL to 2.30.7 to enable DeepEPv2 in the vllm/vllm-openai image (#45321 )

2026-07-24 13:00:02 -07:00

network_utils.py

[Fix] Add missing space in IP fallback warning (#40359 )

2026-04-20 20:26:06 -07:00

numa_utils.py

[Bugfix][Core] Fall back when numactl --membind is blocked in constrained containers (#45438 )

2026-06-16 09:49:56 -07:00

numa_wrapper.sh

[Feature] NUMA binding support for GPU workers (#38635 )

2026-04-08 09:55:24 -07:00

nvtx_pytorch_hooks.py

[Refactor] Remove dead code in multiple files (#49745 )

2026-07-27 15:58:26 -04:00

ompmultiprocessing.py

[CPU] Create Proper Numa topology for s390x (#40714 )

2026-07-13 12:58:43 +08:00

platform_utils.py

[CI/Build][BugFix][The Rock] Fix get_ssm_device_name to return sanitized, usable filename (#47781 )

2026-07-08 12:12:54 +00:00

print_utils.py

[Examples][1/n] Resettle basic examples. (#35579 )

2026-03-08 20:22:53 -07:00

registry.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666 )

2025-11-28 20:40:47 +08:00

serial_utils.py

[Frontend] Add multimodal support to /inference/v1/generate endpoint (#38405 )

2026-04-17 20:31:56 -07:00

sparse_utils.py

[Bugfix][Security] Fix concurrent sparse invariant race bypassing CVE remediation (#48583 )

2026-07-14 11:08:24 +00:00

system_utils.py

[Bugfix] Match the mapped filename in find_loaded_library (#47586 )

2026-07-07 08:06:29 +00:00

tensor_schema.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

torch_utils.py

[2/N][KV-Cache Layout Refactor] Pack K/V into the content dim across attention backends (#44455 )

2026-07-11 11:11:16 -04:00

tqdm_utils.py

[Renderer] Move InputPreprocessor into Renderer (2/2) (#34560 )

2026-02-17 05:29:01 -08:00