vLLM/vllm at ca683a2a729d894286e7fef6afcb4d34b75e37ca - vLLM

assets

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

attention

[DCP] Support Decode Context Parallel (DCP) for GQA with FlashAttention (#24864 )

2025-10-14 13:07:50 +00:00

benchmarks

Add support for the /rerank endpoint in vllm bench serve (#26602 )

2025-10-14 04:25:43 +00:00

compilation

[compile] Enable sequence parallelism for full cuda graph without specifying compile sizes (#26681 )

2025-10-13 18:15:34 -07:00

config

use combo kernel to fuse qk-norm and qk-rope (#26682 )

2025-10-14 09:40:59 -04:00

device_allocator

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

distributed

[NIXL][HeteroTP] Enable KV transfer from HND prefill to NHD decode (#26556 )

2025-10-14 09:46:05 +00:00

engine

[Chore] Remove SupportsV0Only interface and update supported models docs (#26783 )

2025-10-14 04:55:10 -07:00

entrypoints

[Bugfix][FE]: Always include usage with --enable-force-include-usage (#20983 )

2025-10-14 09:17:39 +02:00

executor

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

inputs

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

logging_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

lora

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

model_executor

Adjusted the model order of the model registration file (#26798 )

2025-10-14 13:26:11 +00:00

multimodal

[Model] Use merge_by_field_config for MM models (M-N) (#26710 )

2025-10-14 01:27:01 +08:00

platforms

[Plugin] Make plugin group clear (#26757 )

2025-10-14 07:49:59 +00:00

plugins

[Plugin] Make plugin group clear (#26757 )

2025-10-14 07:49:59 +00:00

profiler

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

ray

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

reasoning

[Model] Add reasoning_parser and tool_parser for Ernie45 thinking (#25027 )

2025-10-13 15:55:20 +08:00

third_party

fix some typos (#24071 )

2025-09-02 20:44:50 -07:00

transformers_utils

[Model][0/N] Improve all pooling task | clean up (#25817 )

2025-10-13 16:44:50 +08:00

triton_utils

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

usage

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

utils

[Log] Optimize Startup Log (#26601 )

2025-10-14 02:06:57 +08:00

v1

[DCP] Support Decode Context Parallel (DCP) for GQA with FlashAttention (#24864 )

2025-10-14 13:07:50 +00:00

vllm_flash_attn

[BugFix] Fix vllm_flash_attn install issues (#17267 )

2025-04-27 17:27:56 -07:00

__init__.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

_bc_linter.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

_custom_ops.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

_ipex_ops.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

beam_search.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

collect_env.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

connections.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

env_override.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

envs.py

[Easy] Fix env type check errors from VLLM_DEBUG_LOG_API_SERVER_RESPONSE (#26742 )

2025-10-14 01:46:44 +00:00

forward_context.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

logger.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

logits_process.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

logprobs.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

outputs.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

pooling_params.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

py.typed

…

sampling_params.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

scalar_type.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

scripts.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

sequence.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

tasks.py

[V1] Get supported tasks from model runner instead of model config (#21585 )

2025-07-25 05:36:45 -07:00

test_utils.py

Remove V0 Encoder-Decoder Support (#24907 )

2025-09-15 21:17:14 -07:00

tracing.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

version.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00