vLLM/vllm at 2a03f93de9d1f8f3f52d55d32c508a2149d02eb2 - vLLM

assets

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

attention

[Attention] Register FLASHMLA_SPARSE (#26441 )

2025-10-08 22:28:52 +00:00

benchmarks

[Bugfix] Incorrect MM data format in vllm bench throughput (#26395 )

2025-10-08 13:52:19 +08:00

compilation

[Frontend] CompilationConfig overhaul (#20283 ): deprecate use_inductor in favor of backend, simplify custom_ops (#26113 )

2025-10-07 12:53:43 -07:00

config

[BugFix] Fix failing test quantization/test_compressed_tensors.py::test_compressed_tensors_fp8_block_enabled (#26436 )

2025-10-08 20:04:12 +00:00

device_allocator

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

distributed

[Attention] Implement universal BACKEND_MAP (#25900 )

2025-10-08 12:00:25 -07:00

engine

[Feature] Change cache.py with pydantic validation (#26390 )

2025-10-08 11:12:59 -07:00

entrypoints

[Bugfix] Fix vllm bench ... on CPU-only head nodes (#25283 )

2025-10-08 16:06:42 +00:00

executor

Fix per file ruff ignores related to simplification (#26259 )

2025-10-05 20:31:53 +00:00

inputs

[Frontend] Consolidate tokenizer init code (#26276 )

2025-10-06 09:34:52 +00:00

logging_utils

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

lora

[Misc] Move LRUCache into its own file (#26342 )

2025-10-07 15:08:40 +00:00

model_executor

[Kernels] Modular kernel refactor (#24812 )

2025-10-08 17:51:52 -04:00

multimodal

[Misc] Move LRUCache into its own file (#26342 )

2025-10-07 15:08:40 +00:00

platforms

[Kernel] Centralize platform kernel import in current_platform.import_kernels (#26286 )

2025-10-08 20:25:31 +00:00

plugins

Remove Python 3.9 support ahead of PyTorch 2.9 in v0.11.1 (#26416 )

2025-10-08 10:40:42 -07:00

profiler

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

ray

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

reasoning

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

third_party

fix some typos (#24071 )

2025-09-02 20:44:50 -07:00

transformers_utils

[Feature] Enable E8M0 by Default on Hopper for DeepGEMM, 5% E2E throughput improvement (#26197 )

2025-10-08 15:33:56 +08:00

triton_utils

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

usage

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

utils

[Feature] Enable E8M0 by Default on Hopper for DeepGEMM, 5% E2E throughput improvement (#26197 )

2025-10-08 15:33:56 +08:00

v1

[Attention] Register FLASHMLA_SPARSE (#26441 )

2025-10-08 22:28:52 +00:00

vllm_flash_attn

[BugFix] Fix vllm_flash_attn install issues (#17267 )

2025-04-27 17:27:56 -07:00

__init__.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

_bc_linter.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

_custom_ops.py

[Kernel] Centralize platform kernel import in current_platform.import_kernels (#26286 )

2025-10-08 20:25:31 +00:00

_ipex_ops.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

beam_search.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

collect_env.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

connections.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

env_override.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

envs.py

[Feature] Enable E8M0 by Default on Hopper for DeepGEMM, 5% E2E throughput improvement (#26197 )

2025-10-08 15:33:56 +08:00

forward_context.py

[Core] Simplify the Dp padding/should ubatch coordination logic (#25768 )

2025-10-07 01:57:49 +00:00

logger.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

logits_process.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

logprobs.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

pooling_params.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

py.typed

Add py.typed so consumers of vLLM can get type checking (#1509 )

2023-10-30 14:50:47 -07:00

sampling_params.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

scalar_type.py

[Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166 )

2025-10-07 09:35:26 -04:00

scripts.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

sequence.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

tasks.py

[V1] Get supported tasks from model runner instead of model config (#21585 )

2025-07-25 05:36:45 -07:00

test_utils.py

Remove V0 Encoder-Decoder Support (#24907 )

2025-09-15 21:17:14 -07:00

tracing.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

version.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00