3 people 3f1e57225a [ROCm][Perf][Kimi-K3] Use AITER Gluon KDA kernels for decode and spec decode (#57392) ...

Signed-off-by: omuhamma <omar.muhammad@amd.com>
Signed-off-by: Nicholas Susanto <nicholas.susanto@amd.com>
Co-authored-by: Nicholas Susanto <nicholas.susanto@amd.com>
Co-authored-by: Simon Danielsson <70206058+simondanielsson@users.noreply.github.com>

2026-10-15 17:54:24 -05:00

..

basic_correctness

[MRV2] Switch CI tests still running on MRV1 unnecessarily (#61014)

2026-10-11 09:57:07 -07:00

benchmarks

[Bugfix][Benchmark] Fix probe latency and duration in bench serve (#60511)

2026-10-15 05:50:30 +00:00

compile

[Bugfix][Compile] Replace Transformers AOT caching with graph caching (#58918)

2026-10-13 19:17:29 +00:00

config

[Chore] Use upstream Transformers DeepseekV4Config (#61392)

2026-10-15 01:08:08 -07:00

cuda

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

detokenizer

[Bugfix][Spec Decode] Trim token_ids/logprobs left past a stop string under speculative decoding (#47616)

2026-10-09 14:22:31 -07:00

device_allocator

[Bugfix] Don't drop the rest of the allocator config when toggling expandable segments (#57982)

2026-09-25 17:34:19 -05:00

distributed

[Perf] Low-latency CPU all-reduce for DP metadata syncs (#61767)

2026-10-15 15:29:13 -07:00

engine

[Bugfix][Platform] Fall back to torch when device-level NVML memory is unsupported (GB10) (#57378)

2026-10-14 12:45:29 +00:00

entrypoints

[Bugfix][Frontend] Reject Cohere REQUIRED tool choice without tools (#61825)

2026-10-15 16:37:08 +00:00

evals

[CI] Pin DeepSeek-V4.1-Flash-NVFP4 eval to its FP8-Engram revision (#61763)

2026-10-15 00:05:18 -07:00

fusion

[Fusion] Support 3D activation quantization fusion and enable it for Pixtral (#59612)

2026-10-09 15:12:03 +08:00

ir

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

jit_monitor

[Perf] JIT monitor: hook TileLang JITImpl.compile instead of __call__ (#58685)

2026-10-08 00:11:59 +00:00

kernels

[ROCm] gfx1250 optimizations and model enablement (#58800)

2026-10-15 14:51:57 -07:00

lora

[Bugfix][LoRA] Apply PEFT rank_pattern / alpha_pattern scaling per module (#59801)

2026-10-12 21:49:30 +08:00

model_executor

[Kernel][DSv4.1] Bump FlashMLA to the 2026.09.30 release and its interleaved V4.1 KV cache (#61371)

2026-10-15 13:58:25 -07:00

models

[ROCm][Perf][Kimi-K3] Use AITER Gluon KDA kernels for decode and spec decode (#57392)

2026-10-15 17:54:24 -05:00

multimodal

[Bugfix][Multimodal] Recover PyNvVideoCodec decoder slots after failures (#59597)

2026-10-15 09:17:19 +03:00

parser

[Bugfix][Parser] Stream Gemma4 string tool arguments incrementally (#61494)

2026-10-14 21:25:41 +00:00

platforms

[Attention] Remove cascade attention (#61126)

2026-10-12 10:41:07 -07:00

plugins

[Bugfix][MRV2] Keep input_ids on later PP stages for raw-token models (#61016)

2026-10-15 12:54:21 -07:00

plugins_tests

[Bugfix][MRV2] Keep input_ids on later PP stages for raw-token models (#61016)

2026-10-15 12:54:21 -07:00

prompts

…

quantization

[Bugfix] Make Humming DeviceInfo lookups traceable under torch.compile (#61858)

2026-10-15 11:12:21 -07:00

reasoning

[Frontend] Port Step-3.5 parsers to the streaming parser engine (#59321)

2026-10-01 22:18:37 +00:00

renderers

[Test] Split the chat_utils tests. (#61765)

2026-10-15 08:26:22 +00:00

rocm

[ROCm][CI] Add test coverage for VLLM_ROCM_MOE_PADDING memory-stride padding transparency (#59332)

2026-10-02 11:23:22 -05:00

samplers

[watermark] compatibility validation (#56801)

2026-10-05 14:37:13 -04:00

spec_decode

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

standalone_tests

[CI] Add nightly Python 3.14 smoke test (#60456)

2026-10-12 10:11:26 -07:00

tokenizers_

[Bugfix] Preserve independent tokenizer code_revision in snapshot resolution (#61272)

2026-10-13 04:23:45 +00:00

tool_parsers

[Bugfix] Fix Apertus streaming scientific notation (#61812)

2026-10-15 16:49:57 +00:00

tool_use

[Frontend] Support CustomToolCall in the non-Harmony Responses API (#57322)

2026-10-12 17:22:55 +08:00

tools

[Agents] Add pre-commit check for agent files and skills (#59657)

2026-10-02 09:38:22 -07:00

tracing

[Refactor] Remove dead tests code (#58916)

2026-09-30 04:39:03 +00:00

transformers_utils

[Chore] Use upstream Transformers DeepseekV4Config (#61392)

2026-10-15 01:08:08 -07:00

utils_

[Frontend] Advertise --enable-x/--disable-x for boolean CLI flags (#61479)

2026-10-15 01:08:02 -07:00

v1

[Perf] Low-latency CPU all-reduce for DP metadata syncs (#61767)

2026-10-15 15:29:13 -07:00

vllm_test_utils

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

watermarking

[watermarking] Add DFlash support to dual-key gumbel-max watermarking (#59554)

2026-10-15 22:06:06 +00:00

__init__.py

…

ci_envs.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

conftest.py

[CI] Keep vLLM log propagation on through the first LLM init in caplog_vllm (#61535)

2026-10-14 15:10:35 +08:00

test_attention_backend_registry.py

[Platform] Allow BackendEnum dynamic register (#41091)

2026-10-08 09:56:19 +08:00

test_audio_media_size_precheck.py

[Security] Bound decoded and downloaded media per request (#61226)

2026-10-13 10:17:14 +00:00

test_cmake_utils.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_config.py

[watermarking] Add DFlash support to dual-key gumbel-max watermarking (#59554)

2026-10-15 22:06:06 +00:00

test_connections.py

[Security] Bound decoded and downloaded media per request (#61226)

2026-10-13 10:17:14 +00:00

test_embedded_commit.py

…

test_envs.py

[Security] Fix P2P ZMQ socket exhaustion via unbounded peer sessions (#51504)

2026-10-11 11:39:11 -04:00

test_force_first_config.py

…

test_fxgraphcache_pickle_patch.py

…

test_logger.py

[Core][Logging] Add built-in JSON formatter (#58739)

2026-10-01 09:11:46 +01:00

test_logprobs.py

[Bugfix] Handle empty FlatLogprobs slices and delta output (#53704)

2026-08-26 21:00:54 +08:00

test_outputs.py

[Bugfix][Core] Preserve speculative metrics when coalescing outputs (#55708)

2026-10-07 08:35:14 +08:00

test_pcp_dp.py

[PCP] Support prefill context parallelism with data parallelism (#57075)

2026-09-23 22:32:36 -04:00

test_pooling_params.py

[Feature][Pooling] Add offline fixed-length late chunking (#60164)

2026-10-13 11:16:21 +00:00

test_quantization_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446)

2026-08-11 04:33:10 +00:00

test_ray_env_utils.py

[Bugfix] Set breakable graph env before Ray actor import (#53293)

2026-08-28 23:11:50 +00:00

test_ray_env.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_regression.py

…

test_request_input_bounds.py

[CI] Allowlist-shrink batch 1: wire 17 root-level tests + drop 5 stale watermarking entries into misc.yaml (#58055)

2026-09-27 22:23:46 -07:00

test_sampling_params.py

[watermark] compatibility validation (#56801)

2026-10-05 14:37:13 -04:00

test_scalartype.py

…

test_sequence.py

…

test_tensorizer_revision_pin.py

Preserve revision pins in secondary artifact loaders (#51446)

2026-08-11 04:33:10 +00:00

test_triton_utils.py

[CI] Allowlist-shrink batch 1: wire 17 root-level tests + drop 5 stale watermarking entries into misc.yaml (#58055)

2026-09-27 22:23:46 -07:00

test_uvicorn_logging.py

[Core][Logging] Add built-in JSON formatter (#58739)

2026-10-01 09:11:46 +01:00

test_version.py

[CI] Allowlist-shrink batch 1: wire 17 root-level tests + drop 5 stale watermarking entries into misc.yaml (#58055)

2026-09-27 22:23:46 -07:00

test_vllm_port.py

…

test_zen_cpu_platform_detection.py

[CPU][Zen] Update zentorch to 2.14.0.1 & enable float16 on Venice and later (#61411)

2026-10-15 00:23:50 -07:00

test_zentorch_version_pin.py

[ZenCPU][Test] Add zentorch/torch version pin consistency test (#52888)

2026-10-06 13:12:19 +08:00

utils.py

[MRV2] Switch CI tests still running on MRV1 unnecessarily (#61014)

2026-10-11 09:57:07 -07:00