3 people 9e88e969c0 [Perf][KVConnector][Mooncake] Parallelize KV load with a receive-thread pool (#45971) ...

Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

2026-06-24 18:25:12 -07:00

..

basic_correctness

…

benchmarks

feat: support to OpenMOSS-Team (#44124)

2026-06-24 00:08:13 -07:00

compile

[ROCm][CI] skip test_double_aiter_rms_quant_fusion (#45967)

2026-06-21 16:53:11 -05:00

config

[ROCm][CI] Fix nixl tests (#45219)

2026-06-23 13:11:40 -05:00

cuda

…

detokenizer

…

distributed

[Model] Remove BaiChuanForCausalLM and BaichuanForCausalLM (#46362)

2026-06-24 16:13:57 +08:00

engine

[Feat] Add runtime monitor for post-warmup CuTeDSL compilation (#46167)

2026-06-23 23:33:17 +00:00

entrypoints

[Frontend] Fix Kimi K2 tool call IDs for required tool choice (#46344)

2026-06-24 19:59:40 +00:00

evals

[ROCm][CI] Shard LM Eval Qwen3-5 Models (B200-MI355) in AMD CI (#46520)

2026-06-23 16:32:05 -05:00

fusion

Add the QuantizedActivation linear-kernel contract (#44260)

2026-06-12 13:48:15 -07:00

ir

…

kernels

[Kernel][MoE] Allow FlashInfer MXINT4 MoE for gated SiLU (#46518)

2026-06-24 18:32:50 -05:00

lora

[CI/Build] Remove BaiChuanForCausalLM from the LoRA test (#46494)

2026-06-23 22:09:48 +08:00

model_executor

Enable DeepSeek V4 and GLM-5.1 on SM120 (#43477)

2026-06-22 11:54:14 -07:00

models

[Feature] Triton INT4 per-token-head KV cache quantization (#40835)

2026-06-24 10:21:25 +00:00

multimodal

fix(security): prevent infinite loop in split_audio with NaN audio sa… (#46463)

2026-06-23 10:24:51 +00:00

parser

[Frontend] Port seed_oss to the streaming parser engine as a Qwen3 subclass (#46314)

2026-06-24 20:08:42 -04:00

plugins

[Misc][Model] add io processor for query/document embeddings from ColBERT (jinaai/jina-colbert-v2) (#45210)

2026-06-16 01:32:32 +00:00

plugins_tests

[BugFix][CI] Fix scheduler plugin test (#45897)

2026-06-17 06:30:49 +00:00

prompts

…

quantization

[Feature] Triton INT4 per-token-head KV cache quantization (#40835)

2026-06-24 10:21:25 +00:00

reasoning

[Frontend] Port seed_oss to the streaming parser engine as a Qwen3 subclass (#46314)

2026-06-24 20:08:42 -04:00

renderers

[Model] Remove BaiChuanForCausalLM and BaichuanForCausalLM (#46362)

2026-06-24 16:13:57 +08:00

rocm/aiter

[ROCm] Fix AITER FP8 quantization schema tests (#46414)

2026-06-24 22:29:19 +08:00

samplers

[Core] Support structured outputs for beam search (#35022)

2026-06-12 06:56:25 -07:00

spec_decode

…

standalone_tests

[ROCm][CI] pass merge-base to container for python-only wheel metadata (#45869)

2026-06-23 15:44:43 +00:00

system_messages

…

tokenizers_

Register parsed config classes before tokenizer init (#40299)

2026-06-16 05:33:08 +00:00

tool_parsers

[Frontend] Port seed_oss to the streaming parser engine as a Qwen3 subclass (#46314)

2026-06-24 20:08:42 -04:00

tool_use

[Bugfix][ToolParser] Handle braces in required tool streaming strings (#45389)

2026-06-23 20:29:34 +00:00

tools

…

tracing

…

transformers_utils

[Migration] Migrate GGUF quantization support to plugin (#39612)

2026-06-12 12:02:21 -07:00

utils_

[Bugfix][Core] Fall back when numactl --membind is blocked in constrained containers (#45438)

2026-06-16 09:49:56 -07:00

v1

[Perf][KVConnector][Mooncake] Parallelize KV load with a receive-thread pool (#45971)

2026-06-24 18:25:12 -07:00

vllm_test_utils

…

weight_loading

…

__init__.py

…

ci_envs.py

[Model][0/N] Improve all pooling task | clean up (#25817)

2025-10-13 16:44:50 +08:00

conftest.py

[Bugfix][V1] Clean up compiled-model bytecode hooks on VllmRunner exit (#45195)

2026-06-16 20:31:17 -07:00

test_access_log_filter.py

[Logging] add --disable-access-log-for-endpoints CLI option (#30011)

2026-01-26 21:49:03 +00:00

test_attention_backend_registry.py

…

test_config.py

[Model Runner V2] Migration to support quantized model by default [5/N] (#44446)

2026-06-18 12:20:44 -07:00

test_embedded_commit.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_envs.py

…

test_force_first_config.py

[Perf] Add VLLM_TRITON_FORCE_FIRST_CONFIG to skip Triton autotuning (#42425)

2026-06-16 15:16:45 +02:00

test_fxgraphcache_pickle_patch.py

…

test_inputs.py

[Refactor] Pass full VllmConfig to Renderer (#34485)

2026-02-12 22:48:38 -08:00

test_jit_monitor.py

[Feat] Add runtime monitor for post-warmup CuTeDSL compilation (#46167)

2026-06-23 23:33:17 +00:00

test_logger.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

test_logprobs.py

…

test_outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_pooling_params.py

[Bugfix] Reject matryoshka embedding dimensions above hidden size (#46313)

2026-06-22 10:16:35 +00:00

test_ray_env_utils.py

…

test_ray_env.py

…

test_regression.py

…

test_scalartype.py

…

test_sequence.py

…

test_triton_utils.py

…

test_version.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_vllm_port.py

…

test_zen_cpu_platform_detection.py

…

utils.py

…