3 people 3354dba381 [Bugfix][KV offload] Store interior chunk-boundary blocks under MTP/Eagle (#46972) ...

Signed-off-by: Mikhail Kostryukov <mike@triptrack.net>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>

2026-07-07 13:16:52 +03:00

..

basic_correctness

[Platform] Replace torch.cuda.mem_get_info with torch.accelerator.get_memory_info (#44825)

2026-06-30 14:39:52 +08:00

benchmarks

[CI] Bump huggingface-hub from v1.10.2 to v1.22.0 (#47551)

2026-07-04 07:45:45 -07:00

compile

[ROCm][CI] Refresh ROCm base images when docker rocm_base changes (#46904)

2026-07-07 03:10:50 -07:00

config

[Bugfix] Forward callable hf_overrides to the draft model config (#45352)

2026-07-06 21:12:38 -07:00

cuda

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

detokenizer

[CI/Build] Remove use of skip_v1 (#34699)

2026-02-18 12:19:11 +08:00

distributed

[CI] Fix some errors on main (#47726)

2026-07-06 19:40:23 +00:00

engine

[Feat] Add runtime monitor for post-warmup CuTeDSL compilation (#46167)

2026-06-23 23:33:17 +00:00

entrypoints

fix: use configured max_logprobs instead of hardcoded 20 in derender validation (#47834)

2026-07-07 09:42:47 +00:00

evals

[Quantization] add humming moe backend to all dense/moe oracles (#41652)

2026-07-06 13:36:07 -07:00

fusion

Add the QuantizedActivation linear-kernel contract (#44260)

2026-06-12 13:48:15 -07:00

ir

[Perf] Set IR Op Priority Once at Worker Init (#42631)

2026-05-15 15:56:13 +00:00

kernels

[ROCm][CI] Refresh ROCm base images when docker rocm_base changes (#46904)

2026-07-07 03:10:50 -07:00

lora

[Test][LoRA] Use lightweight CPU reference and skip heavy cleanup in punica ops tests (#47534)

2026-07-06 11:29:59 +08:00

model_executor

[Bugfix][Model] Allow Run:ai memory_limit sentinel values (#47337)

2026-07-05 00:08:34 +00:00

models

[Bugfix] Forward callable hf_overrides to the draft model config (#45352)

2026-07-06 21:12:38 -07:00

multimodal

Add TorchCodec as a video decoding backend (#46609)

2026-07-06 19:58:51 -07:00

parser

[Bugfix][Frontend][gpt-oss] Recover raw tail when Harmony parser ends non-terminal (#47379)

2026-07-04 10:46:24 -04:00

plugins

[Misc][Model] add io processor for query/document embeddings from ColBERT (jinaai/jina-colbert-v2) (#45210)

2026-06-16 01:32:32 +00:00

plugins_tests

[BugFix][CI] Fix scheduler plugin test (#45897)

2026-06-17 06:30:49 +00:00

prompts

…

quantization

[ROCm][Bugfix] Convert ModelOpt FP8 per-channel weights to e4m3fnuz on MI300/MI325 (#47201)

2026-07-06 23:24:58 -07:00

reasoning

[Frontend] [Parser] Port DeepSeek V4 to streaming parser engine framework (#45877)

2026-07-03 20:55:23 -04:00

renderers

[CI] Bump huggingface-hub from v1.10.2 to v1.22.0 (#47551)

2026-07-04 07:45:45 -07:00

rocm/aiter

[ROCm] Fix AITER FP8 quantization schema tests (#46414)

2026-06-24 22:29:19 +08:00

samplers

[Bugfix] Fix beam search candidate indexing when logprobs count varies (#47126)

2026-07-01 07:07:06 +00:00

spec_decode

[Feature] Support custom callable proposer backend for speculative decoding (#39487)

2026-05-13 16:53:01 +00:00

standalone_tests

[ROCm][CI] pass merge-base to container for python-only wheel metadata (#45869)

2026-06-23 15:44:43 +00:00

system_messages

…

tokenizers_

[CI] Bump huggingface-hub from v1.10.2 to v1.22.0 (#47551)

2026-07-04 07:45:45 -07:00

tool_parsers

[ROCm][CI][Bugfix] Fix flaky parallel tool-call streaming (test assertion + Mistral/Granite parsers) (#47550)

2026-07-06 19:06:19 -04:00

tool_use

[ROCm][CI][Bugfix] Fix flaky parallel tool-call streaming (test assertion + Mistral/Granite parsers) (#47550)

2026-07-06 19:06:19 -04:00

tools

[ROCm][CI] Adding metadata (#47477)

2026-07-02 17:45:23 -07:00

tracing

[CI][Tracing] Fix race condition by adding server readiness check (#34364)

2026-02-16 12:57:39 +00:00

transformers_utils

[CI] Don't try and download files that we already know don't exist (#46854)

2026-06-26 23:56:39 +00:00

utils_

[Platform] Replace torch.cuda.mem_get_info with torch.accelerator.get_memory_info (#44825)

2026-06-30 14:39:52 +08:00

v1

[Bugfix][KV offload] Store interior chunk-boundary blocks under MTP/Eagle (#46972)

2026-07-07 13:16:52 +03:00

vllm_test_utils

…

weight_loading

[Quant] Consolidate GPTQ: rename gptq_marlin.py to auto_gptq.py (#38288)

2026-05-15 08:25:52 +08:00

__init__.py

…

ci_envs.py

…

conftest.py

[ROCm][CI] Explicitly tear down multimodal offline LLMs (#46999)

2026-06-29 07:59:24 +00:00

test_access_log_filter.py

[Logging] add --disable-access-log-for-endpoints CLI option (#30011)

2026-01-26 21:49:03 +00:00

test_attention_backend_registry.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

test_config.py

[UX] Add model_class_overrides for development and debugging (#47148)

2026-07-07 11:43:08 +08:00

test_embedded_commit.py

…

test_envs.py

[Build] fix self-contradictory precompiled-flag orthogonality test (#44942)

2026-06-11 12:49:08 +08:00

test_force_first_config.py

[Perf] Add VLLM_TRITON_FORCE_FIRST_CONFIG to skip Triton autotuning (#42425)

2026-06-16 15:16:45 +02:00

test_fxgraphcache_pickle_patch.py

[ZenCPU] Make PT Backport Patch Accessible to vLLM (#38205)

2026-04-10 08:29:35 +00:00

test_inputs.py

[Refactor] Pass full VllmConfig to Renderer (#34485)

2026-02-12 22:48:38 -08:00

test_jit_monitor.py

[Feat] Add runtime monitor for post-warmup CuTeDSL compilation (#46167)

2026-06-23 23:33:17 +00:00

test_logger.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

test_logprobs.py

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

test_outputs.py

…

test_pooling_params.py

[Bugfix] Reject matryoshka embedding dimensions above hidden size (#46313)

2026-06-22 10:16:35 +00:00

test_ray_env_utils.py

[Feat][Executor] Introduce RayExecutorV2 (#36836)

2026-04-01 14:34:29 -07:00

test_ray_env.py

fix nixl side-channel host selection (#41806)

2026-05-11 07:40:37 +00:00

test_regression.py

[CI/Build] Use modelscope's international site for regression test (#42176)

2026-05-09 19:47:09 -07:00

test_scalartype.py

…

test_sequence.py

…

test_triton_utils.py

…

test_version.py

…

test_vllm_port.py

…

test_zen_cpu_platform_detection.py

In-Tree AMD Zen CPU Backend via zentorch [1/N] (#35970)

2026-03-15 23:35:35 +00:00

utils.py

[ROCm][AITER] Directly Implement AITER Custom All-reduce in CudaCommunicator (#46065)

2026-07-06 12:16:32 +00:00