Wenlong WangandRoger Wang 035fd2bd2c [Multi Modal][Performance] Fused Q,K's apply_rope in more models (#25005) ...

Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

2025-09-21 03:55:10 +00:00

..

assets

[Bugfix] Fix GLM4.1V multimodal processor with compatability for Transformers v4.56 (#24822)

2025-09-15 20:45:06 +08:00

attention

[V0 Deprecation] Remove V0 model runner base & simplify worker base (#25328)

2025-09-20 20:49:09 -07:00

benchmarks

refactor(benchmarks): add type annotations to wait_for_endpoint parameters (#25218)

2025-09-19 16:36:52 +00:00

compilation

[BugFix] Ensure appropriate guards in destructors (#25284)

2025-09-20 09:06:34 +08:00

config

[Optimization] Avoid repeated model architecture conversion for pooling models (#25261)

2025-09-20 13:30:22 +08:00

device_allocator

[sleep mode] save memory for on-the-fly quantization (#24731)

2025-09-12 11:25:19 +00:00

distributed

[BugFix] Ensure appropriate guards in destructors (#25284)

2025-09-20 09:06:34 +08:00

engine

[V0 Deprecation] Remove V0 core (#25321)

2025-09-20 19:58:26 -07:00

entrypoints

[V0 Deprecation] Remove LLMEngine (#25033)

2025-09-20 17:56:30 -07:00

executor

[V1] Support LLM.apply_model (#18465)

2025-09-20 07:14:35 +00:00

inputs

[Core] Remove tokenizer group in vLLM (#24078)

2025-09-17 08:42:59 +00:00

logging_utils

Generate _ModelInfo properties file when loading to improve loading speed (#23558)

2025-09-20 11:51:13 +00:00

lora

[Core] Modify the initialization parameters of the lora manager (#25249)

2025-09-19 18:01:28 +00:00

model_executor

[Multi Modal][Performance] Fused Q,K's apply_rope in more models (#25005)

2025-09-21 03:55:10 +00:00

multimodal

[Docs] Fix warnings in mkdocs build (continued) (#25042)

2025-09-20 11:45:18 +00:00

platforms

[OOT] Support sync_model_loading for OOT (#25126)

2025-09-19 05:41:53 +00:00

plugins

Change log level from info to debug for IOProcessor (#24999)

2025-09-17 10:21:28 -07:00

profiler

[Docs] Fix warnings in vllm/profiler and vllm/transformers_utils (#25220)

2025-09-20 16:39:47 -07:00

ray

…

reasoning

[gpt-oss] tool parser supports for /chat/completions [1/n] (#22386)

2025-09-04 20:39:12 -07:00

third_party

…

transformers_utils

[Docs] Fix warnings in vllm/profiler and vllm/transformers_utils (#25220)

2025-09-20 16:39:47 -07:00

triton_utils

[benchmark] Add triton version in the moe tuned config (#24769)

2025-09-16 14:10:54 +08:00

usage

…

utils

[Docs] Fix warnings in mkdocs build (continued) (#25042)

2025-09-20 11:45:18 +00:00

v1

[V0 Deprecation] Remove V0 core (#25321)

2025-09-20 19:58:26 -07:00

vllm_flash_attn

…

worker

[V0 Deprecation] Remove V0 model runner base & simplify worker base (#25328)

2025-09-20 20:49:09 -07:00

__init__.py

[CI/Build] Add bc-linter to vLLM CI (#21234)

2025-09-11 15:34:36 -07:00

_bc_linter.py

[CI/Build] Add bc-linter to vLLM CI (#21234)

2025-09-11 15:34:36 -07:00

_custom_ops.py

Remove old cutlass mla (#23961)

2025-09-17 14:31:43 +00:00

_ipex_ops.py

[Chore] Remove ipex_ops warning (#24835)

2025-09-14 19:41:53 +00:00

beam_search.py

…

collect_env.py

[BugFix] python collect_env.py and vllm collect-env compatibility with uv venv (#24066)

2025-09-10 21:25:33 +08:00

connections.py

…

env_override.py

…

envs.py

[Bugfix] Remove VLLM_TEST_DYNAMO_FULLGRAPH_CAPTURE #2969 (#25090)

2025-09-19 20:27:21 -04:00

forward_context.py

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

2025-09-16 12:21:48 -04:00

logger.py

[Logging] allow config logging stream (#24336)

2025-09-10 15:02:01 +00:00

logits_process.py

…

logprobs.py

…

outputs.py

…

pooling_params.py

[Docs] Fix pooling-params doc references in openai_compatible_server.md (#24939)

2025-09-18 04:36:47 -07:00

py.typed

…

sampling_params.py

[Docs] add the parallel sampling usage in LLMEngine and AsyncLLM (#24222)

2025-09-18 04:37:08 -07:00

scalar_type.py

…

scripts.py

…

sequence.py

…

tasks.py

…

test_utils.py

Remove V0 Encoder-Decoder Support (#24907)

2025-09-15 21:17:14 -07:00

tracing.py

[V1] feat:add engine v1 tracing (#20372)

2025-09-11 17:10:39 -07:00

version.py

…