vLLM/vllm/utils at d4cb783c10ffc091af7f09a3b052dceadc06d075 - vLLM

__init__.py

[Refactor] Use data parser for matching data items to multi-modal UUIDs (#32955 )

2026-01-26 15:00:28 +08:00

argparse_utils.py

[Misc] Update deprecation warning for --model flag (#39518 )

2026-04-10 23:25:20 -07:00

async_utils.py

[Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop (#34789 )

2026-03-26 22:17:00 -07:00

cache.py

[Docs] Mock all imports for docs (#27873 )

2025-11-01 10:02:23 +00:00

collection_utils.py

[Plugin] Simplify IO Processor Plugin interface (#34236 )

2026-02-10 19:47:39 -08:00

counter.py

[Misc] Separate out utils.counter and move utils.Device to engine (#27588 )

2025-10-28 12:20:46 +00:00

cpu_triton_utils.py

feat(cpu): add CPU support for draft model speculative decoding (#32662 )

2026-04-10 11:49:52 +08:00

deep_gemm.py

[UX] Integrate DeepGEMM into vLLM wheel via CMake (#37980 )

2026-04-08 18:56:32 -07:00

flashinfer.py

[W8A8 Block Linear Refactor][2/N] Remove W8A8Fp8BlockLinearOp and adopt Fp8 block linear kernel selections. (#33892 )

2026-04-09 08:50:39 +08:00

func_utils.py

[Refactor] Remove unused utils (#38153 )

2026-03-26 17:08:19 +08:00

gc_utils.py

[Doc]: fixing typos in multiple files. (#29685 )

2025-11-28 08:41:41 -08:00

hashing.py

[Core] Add xxHash as a high-performance hash option for accelerating prefix caching (#29163 )

2025-12-03 16:06:57 +00:00

import_utils.py

[UX] Integrate DeepGEMM into vLLM wheel via CMake (#37980 )

2026-04-08 18:56:32 -07:00

jsontree.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666 )

2025-11-28 20:40:47 +08:00

math_utils.py

[Refactor] Remove unused utils (#38153 )

2026-03-26 17:08:19 +08:00

mem_constants.py

[Tests] Add Qwen3-VL multimodal memory leak check (#39268 )

2026-04-09 04:54:46 -07:00

mem_utils.py

[Tests] Add Qwen3-VL multimodal memory leak check (#39268 )

2026-04-09 04:54:46 -07:00

mistral.py

[Feature] Lazy import for the "mistral" tokenizer module. (#34651 )

2026-02-23 00:43:01 -08:00

multi_stream_utils.py

[Perf] Enable dual stream execution of input projection for Qwen3 (#36795 )

2026-03-18 11:13:27 +08:00

nccl.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666 )

2025-11-28 20:40:47 +08:00

network_utils.py

Fix DP coordinator ZMQ port TOCTOU (#37452 )

2026-03-20 00:58:31 +00:00

numa_utils.py

[Feature] NUMA binding support for GPU workers (#38635 )

2026-04-08 09:55:24 -07:00

numa_wrapper.sh

[Feature] NUMA binding support for GPU workers (#38635 )

2026-04-08 09:55:24 -07:00

nvtx_pytorch_hooks.py

[Feature] Add Layer-wise NVTX Support (#29990 )

2025-12-05 11:20:07 +00:00

ompmultiprocessing.py

[Bugfix][CPU] Fix macOS compatibility broken by #36487 (#38970 )

2026-04-04 14:05:58 +00:00

platform_utils.py

[Platform] Add current_platform.num_compute_units interface (#35042 )

2026-02-24 22:22:49 -08:00

print_utils.py

[Examples][1/n] Resettle basic examples. (#35579 )

2026-03-08 20:22:53 -07:00

profiling.py

[Chore] Separate out profiling utilities from vllm.utils (#27150 )

2025-10-18 19:12:01 +00:00

registry.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666 )

2025-11-28 20:40:47 +08:00

serial_utils.py

[Refactor] Clean up pooling serial utils (#33665 )

2026-02-03 10:29:18 +00:00

system_utils.py

[Feature] NUMA binding support for GPU workers (#38635 )

2026-04-08 09:55:24 -07:00

tensor_schema.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

torch_utils.py

[compile] Allow strings in custom ops without regressing compilation times (#38123 )

2026-04-10 07:26:37 +00:00

tqdm_utils.py

[Renderer] Move InputPreprocessor into Renderer (2/2) (#34560 )

2026-02-17 05:29:01 -08:00