4 people 76afe4edf8 [Bugfix] Fix vllm bench ... on CPU-only head nodes (#25283) ...

Signed-off-by: Aydin Abiar <aydin@anyscale.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Aydin Abiar <aydin@anyscale.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

2025-10-08 16:06:42 +00:00

..

assets

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

attention

[Misc] Clean up cruft from previous FlashMLA sparse implementation (#26125)

2025-10-08 10:09:34 +08:00

benchmarks

[Bugfix] Incorrect MM data format in vllm bench throughput (#26395)

2025-10-08 13:52:19 +08:00

compilation

[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops (#26113)

2025-10-07 12:53:43 -07:00

config

Tidy vllm/config/__init__.py to only add classes and functions (#26405)

2025-10-08 07:10:00 -07:00

device_allocator

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

distributed

[TPU] Rename tpu_commons to tpu_inference (#26279)

2025-10-07 23:30:52 -07:00

engine

Tidy vllm/config/__init__.py to only add classes and functions (#26405)

2025-10-08 07:10:00 -07:00

entrypoints

[Bugfix] Fix vllm bench ... on CPU-only head nodes (#25283)

2025-10-08 16:06:42 +00:00

executor

Fix per file ruff ignores related to simplification (#26259)

2025-10-05 20:31:53 +00:00

inputs

[Frontend] Consolidate tokenizer init code (#26276)

2025-10-06 09:34:52 +00:00

logging_utils

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

lora

[Misc] Move LRUCache into its own file (#26342)

2025-10-07 15:08:40 +00:00

model_executor

[Refactor] Refactor FP8 & INT8 Quant Folder inside w8a8 (#25293)

2025-10-08 10:20:48 -04:00

multimodal

[Misc] Move LRUCache into its own file (#26342)

2025-10-07 15:08:40 +00:00

platforms

[Bugfix] Fix vllm bench ... on CPU-only head nodes (#25283)

2025-10-08 16:06:42 +00:00

plugins

Fix per file ruff ignores related to typing (#26254)

2025-10-05 16:37:55 +00:00

profiler

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

ray

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

reasoning

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

third_party

fix some typos (#24071)

2025-09-02 20:44:50 -07:00

transformers_utils

[Feature] Enable E8M0 by Default on Hopper for DeepGEMM, 5% E2E throughput improvement (#26197)

2025-10-08 15:33:56 +08:00

triton_utils

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

usage

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

utils

[Feature] Enable E8M0 by Default on Hopper for DeepGEMM, 5% E2E throughput improvement (#26197)

2025-10-08 15:33:56 +08:00

v1

Tidy vllm/config/__init__.py to only add classes and functions (#26405)

2025-10-08 07:10:00 -07:00

vllm_flash_attn

[BugFix] Fix vllm_flash_attn install issues (#17267)

2025-04-27 17:27:56 -07:00

__init__.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

_bc_linter.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

_custom_ops.py

Add gather_indexer_k_quant_cache kernel (#25931)

2025-10-08 04:58:57 +00:00

_ipex_ops.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

beam_search.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

collect_env.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

connections.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

env_override.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

envs.py

[Feature] Enable E8M0 by Default on Hopper for DeepGEMM, 5% E2E throughput improvement (#26197)

2025-10-08 15:33:56 +08:00

forward_context.py

[Core] Simplify the Dp padding/should ubatch coordination logic (#25768)

2025-10-07 01:57:49 +00:00

logger.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

logits_process.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

logprobs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

pooling_params.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

py.typed

Add py.typed so consumers of vLLM can get type checking (#1509)

2023-10-30 14:50:47 -07:00

sampling_params.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

scalar_type.py

[Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166)

2025-10-07 09:35:26 -04:00

scripts.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

sequence.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

tasks.py

[V1] Get supported tasks from model runner instead of model config (#21585)

2025-07-25 05:36:45 -07:00

test_utils.py

Remove V0 Encoder-Decoder Support (#24907)

2025-09-15 21:17:14 -07:00

tracing.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

version.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00