Ning Xie c907d22158 [refactor] refactor memory constants usage (#31865) ...

Signed-off-by: Andy Xie <andy.xning@gmail.com>

2026-01-07 18:37:31 +00:00

..

__init__.py

[Chore][1/2] Drop v0.14 deprecations (#31285)

2025-12-24 09:54:01 -08:00

argparse_utils.py

[Docs] Improve malformed exception caused by backslash line continuations (#31694)

2026-01-05 17:51:54 -08:00

async_utils.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

cache.py

[Docs] Mock all imports for docs (#27873)

2025-11-01 10:02:23 +00:00

collection_utils.py

[Misc] Remove redundant ClassRegistry (#29681)

2025-11-28 15:24:47 -08:00

counter.py

[Misc] Separate out utils.counter and move utils.Device to engine (#27588)

2025-10-28 12:20:46 +00:00

deep_gemm.py

[Bugfix][Hardware][AMD] Consolidate FP8 min/max values helper function (#31106)

2026-01-07 06:55:03 +00:00

flashinfer.py

[Perf][Kernels] Enable FlashInfer DeepGEMM swapAB on SM90 (for W8A8 Linear Op) (#29213)

2026-01-07 10:53:54 -05:00

func_utils.py

[Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169)

2025-10-19 05:20:55 -07:00

gc_utils.py

[Doc]: fixing typos in multiple files. (#29685)

2025-11-28 08:41:41 -08:00

hashing.py

[Core] Add xxHash as a high-performance hash option for accelerating prefix caching (#29163)

2025-12-03 16:06:57 +00:00

import_utils.py

[Chore] Try remove init_cached_hf_modules (#31786)

2026-01-07 12:34:04 +08:00

jsontree.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

math_utils.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

mem_constants.py

[Chore] Separate out vllm.utils.mem_utils (#27143)

2025-10-18 10:06:59 +00:00

mem_utils.py

[refactor] refactor memory constants usage (#31865)

2026-01-07 18:37:31 +00:00

nccl.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

network_utils.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

nvtx_pytorch_hooks.py

[Feature] Add Layer-wise NVTX Support (#29990)

2025-12-05 11:20:07 +00:00

platform_utils.py

[BugFix][ROCm] Fix get_cu_count missing variable error (#28608)

2025-11-13 05:18:56 +00:00

profiling.py

[Chore] Separate out profiling utilities from vllm.utils (#27150)

2025-10-18 19:12:01 +00:00

registry.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

serial_utils.py

[Frontend] Binary embedding response does not return metadata by setting encoding_format to bytes_only. (#30249)

2025-12-08 12:01:21 +00:00

system_utils.py

refactor: find_loaded_library (#31866)

2026-01-07 06:42:20 +00:00

tensor_schema.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

torch_utils.py

[Platform] Deprecate seed_everything (#31659)

2026-01-04 18:34:04 -08:00