 Varun Sundar RabindranathandVarun Sundar Rabindranath
|
68567ef2df
|
[CPUOffloadingManager] Maintain evictable list in LRUCachePolicy (#46216)
Signed-off-by: <>
Co-authored-by: Varun Sundar Rabindranath <varun-sundar-rabindranath@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
|
2026-06-22 06:54:44 +00:00 |
|
|
Jiangyun ZhuandYifan Qiao
|
6bc6f2d86d
|
[1/N][Core] add partial prefix cache primitives (#45939)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-06-21 23:43:10 -07:00 |
|
|
wang.yuqi
|
1eb2cc961e
|
[Frontend] Refactor ServingTokenization entrypoint. (#46022)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-06-22 06:27:58 +00:00 |
|
|
Reidandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
31124749d1
|
[Bugfix] [Rust Frontend] Fix stop string truncation with repeated matches (#46113)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2026-06-22 14:11:29 +08:00 |
|
|
Ma Jian
|
9037498c22
|
[DSV4][XPU] Pass gemm1_clamp_limit to XpuFusedMoe (#44517)
Signed-off-by: Ma Jian <jian1.ma@intel.com>
|
2026-06-22 12:57:10 +08:00 |
|
|
gq112andgss
|
db32b53e30
|
[SpecDecode] Support DFlash with FlashInfer (#43081)
Signed-off-by: gss <2783977641@qq.com>
Co-authored-by: gss <2783977641@qq.com>
|
2026-06-22 04:55:30 +00:00 |
|
|
xiangdong
|
b529bfd6c5
|
[XPU][CI] Add agent_tags for Intel GPU CI (#45768)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
|
2026-06-22 10:33:17 +08:00 |
|
|
Micah Williamson
|
f3df7a7231
|
[ROCm][CI] Enable kv_connector unit tests on ROCm (#45955)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-06-22 05:08:44 +03:00 |
|
|
fxmarty-amdandAndreas Karatzas
|
485bbe1c6f
|
[CI] Fix missing tp_size attribute on RoutedExperts (#46163)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-21 18:46:49 -06:00 |
|
|
Matt
|
a19ff2218a
|
[Hardware][AMD][CI] Fix Spec Decode Eagle test group (#46018)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-06-21 17:40:02 -05:00 |
|
|
Matt
|
4f0d0049a0
|
[Hardware][AMD][CI] Fix Kernels Attention test groups (#46080)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-06-21 17:10:51 -05:00 |
|
|
Charlie FuandAndreas Karatzas
|
13b83d77ad
|
[ROCm][CI] skip test_double_aiter_rms_quant_fusion (#45967)
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-21 16:53:11 -05:00 |
|
|
Matt
|
50241602fd
|
[Hardware][AMD][CI] Fix gfx942 Kernels MoE test group (#46298)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-06-21 16:45:37 -05:00 |
|
|
Ting SUN
|
12fe2a9aac
|
[Bugfix][Qwen3-VL] Fix multi-video crash with list-valued fps/num_frames (#46305)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-06-21 14:31:23 -07:00 |
|
|
Benjamin Chislett
|
89bd2c14d3
|
[Spec Decode] Add Qwen3 architecture support for EAGLE3 (#43132)
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-06-21 13:55:26 -07:00 |
|
|
ZedongLiu
|
9c450b1027
|
[Kernel][Bugfix] Fix INT8 per-token-head KV cache rounding in Triton reshape-and-cache (#45361)
Signed-off-by: ZedongLiu <113341356+Zedong-Liu@users.noreply.github.com>
|
2026-06-21 15:59:40 -04:00 |
|
|
|
635c38338a
|
[Multimodal] Add Qwen2-VL/Qwen2.5-VL processor-mapped video loader (#45555)
Signed-off-by: Ranran <hzz5361@psu.edu>
Signed-off-by: Ranran Haoran Zhang <ranzhang@redhat.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
|
2026-06-21 18:56:50 +00:00 |
|
|
Srinivas Krovvidiandsrinivas_oo7
|
c441ad1c07
|
[KV Offloading] Add labeled metrics support (#45957)
Signed-off-by: srinivas_oo7 <sklinkedin0120@gmail.com>
Co-authored-by: srinivas_oo7 <sklinkedin0120@gmail.com>
|
2026-06-21 18:04:01 +00:00 |
|
|
Jee Jee Li
|
745bba5ea8
|
[Model]Fix MiniMaxM2ForCausalLM perf regression (#45935)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-06-22 00:28:52 +08:00 |
|
|
|
2cac89f9da
|
[Spec Decode] Support mixed KV page sizes for DFlash (#45181)
Signed-off-by: Alex Steiner <asteiner@nvidia.com>
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Giancarlo Delfin <gdelfin@inferact.ai>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-06-21 22:45:14 +08:00 |
|
|
|
3e6e33526d
|
[Disagg] return routed_experts on streaming generate responses (#44638)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
|
2026-06-21 07:37:10 -07:00 |
|
|
|
b91b7726e0
|
[ROCm][P/D] Support MiniMax-M3 mixed KV layouts in MoRIIO READ mode (#46039)
Signed-off-by: Jun Kang Chow <junkangchow@gmail.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Hongxia Yang <hongxia.yang@amd.com>
Co-authored-by: Tan Pin Siang <tanpinsiang@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Chun Fang <chun.fang@amd.com>
Co-authored-by: TianDi101 <ditian12@amd.com>
Co-authored-by: functionstackx <47992694+functionstackx@users.noreply.github.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-21 12:55:19 +00:00 |
|
|
Palaiologos1453
|
d3ad8e8bcd
|
[Bugfix] Defer offload reads while transfers are pending (#46231)
Signed-off-by: test test <2260891073@qq.com>
|
2026-06-21 14:30:13 +03:00 |
|
|
xiaolinchenandwentian-byte
|
b80ce9dd2f
|
[CI][test] Replace InternVL2-1B with InternVL3-1B in test_pipeline_parallel.py (#46241)
Signed-off-by: wentian-byte <192079369+wentian-byte@users.noreply.github.com>
Co-authored-by: wentian-byte <192079369+wentian-byte@users.noreply.github.com>
|
2026-06-21 15:11:19 +08:00 |
|
|
Shifani RajaboseandKunshang Ji
|
b5495cc5f9
|
Fix memory pointer overflow in Mamba state buffers (#44665)
Signed-off-by: Shifani Rajabose <shifani.rajabose@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-06-21 14:00:50 +08:00 |
|
|
Ting SUN
|
183a430c13
|
[Bugfix][Model Runner V2] Fix min_tokens off-by-one in the V2 GPU sampler (#46243)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-06-21 05:06:49 +00:00 |
|
|
Matt
|
a346d589f5
|
[Bugfix] Fix NVFP4/OCP MX MoE emulation (#46254)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-06-20 23:13:10 -05:00 |
|
|
Nick Hill
|
7df3d7dada
|
[Core] Ensure memory is pinned prior to async h2d copy (#45424)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-06-20 20:02:24 -07:00 |
|
|
Umut PolatandFlora Feng
|
8dd1b702f2
|
[Misc] Fix stale doc URL and docstring module path (#35530)
Signed-off-by: umut-polat <52835619+umut-polat@users.noreply.github.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-06-20 23:57:01 +00:00 |
|
|
aoshen02andMartin Hickey
|
f57ac274b2
|
[Render] Add reasoning/tool parsing to /derender + fix byte-fallback FFFD (#45919)
Signed-off-by: aoshen524 <aoshen524@gmail.com>
Co-authored-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-06-20 19:43:32 -04:00 |
|
|
|
6e919960af
|
[Perf] Skip/shrink all_token_ids copy in scheduler for non-async and V2 runner (#45840)
Signed-off-by: amanchugh89 <amanchugh.89@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-06-20 22:36:57 +00:00 |
|
|
Jonathan Chen
|
c88d3d4775
|
[SimpleCPUOffloadConnector] PCP + DCP support (#39831)
Signed-off-by: Jonathan Chen <chenleejonathan@gmail.com>
|
2026-06-20 15:01:06 -07:00 |
|
|
Yifan Qiao
|
ab7fcbdd5d
|
[Perf][KVConnector][Mooncake] Compact chunk-hash keys and zero-copy lookup wire format (#45969)
|
2026-06-20 15:00:11 -07:00 |
|
|
Varun Sundar RabindranathandVarun Sundar Rabindranath
|
3b4a76b63f
|
[KV-Offloading] : Expose CPU cache usage metric (#45737)
Signed-off-by: Varun Sundar Rabindranath <varun-sundar-rabindranath@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
Signed-off-by: <>
Co-authored-by: Varun Sundar Rabindranath <varun-sundar-rabindranath@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
|
2026-06-20 21:21:55 +00:00 |
|
|
|
cc22621b51
|
[KV Offload] Support packed HMA KV cache layout (#46205)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
|
2026-06-20 21:19:40 +00:00 |
|
|
Tyler Michael SmithandClaude Opus 4.6
|
77148992cf
|
[Bugfix] Move extract_layer_index back inside is_v32 guard (#46199)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-06-20 21:19:10 +00:00 |
|
|
shuoming zhangandTyler Michael Smith
|
891cc4b9c5
|
[Frontend] Report cache usage in Anthropic /v1/messages API (#40912)
Signed-off-by: mistral0105 <zhangshuoming17@mails.ucas.ac.cn>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
|
2026-06-20 21:12:48 +00:00 |
|
|
TJian
|
1bdf9810aa
|
[ROCm] [Bugfix] Bugfix ROCm Sparse Indexer (#46222)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
2026-06-20 13:38:42 -07:00 |
|
|
|
ebfbcfe46a
|
Stop setting CUDA_VISIBLE_DEVICES internally in vLLM, add device_ids arg (#45026)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: kourosh hakhamaneshi <kouroshHakha@users.noreply.github.com>
|
2026-06-20 13:38:10 -07:00 |
|
|
Tyler Michael SmithandClaude Opus 4.6
|
e9de72fe6c
|
[Bugfix] Guard model_config access in _log_compilation_config (#46198)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-06-20 19:26:38 +00:00 |
|
|
L丶andmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
d272418f45
|
[Perf] Optimize Qwen3-VL multi-video prompt processing (#46026)
Signed-off-by: Sirius29 <422058530@qq.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-20 07:09:18 -07:00 |
|
|
Sumanth R Hegde
|
7ff7f5c8eb
|
Revert "Fix Stale Encoder Cache After Weight Update" (#46125)
|
2026-06-20 07:09:09 -07:00 |
|
|
Mattandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
dced290769
|
[Hardware][AMD][CI] Fix e2e core test group (#46024)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-20 02:04:35 -05:00 |
|
|
JasonLi314
|
93bad11912
|
[Bugfix] Fix gridDim.y overflow for large row counts (#45255)
Signed-off-by: Jason Li <li.jason.cs@gmail.com>
|
2026-06-19 23:27:45 -04:00 |
|
|
djramic
|
0fbf42af84
|
[ROCm] Fix VRAM not freed in test_phi3v (#46046)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
|
2026-06-19 17:20:59 -05:00 |
|
|
Charlie Fu
|
e6cd8913dd
|
[ROCm][CI] Skip Qwen3.5-35B-A3B-MXFP4-AITER-TP2 for non gfx950 (#46109)
Signed-off-by: charlifu <charlifu@amd.com>
|
2026-06-19 17:20:10 -05:00 |
|
|
Ben Browning
|
859e4d436b
|
[Bugfix][Parser] Fix U+FFFD leak at reasoning-to-content transition in engine parsers (#46159)
Signed-off-by: Ben Browning <bbrownin@redhat.com>
|
2026-06-19 22:09:28 +00:00 |
|
|
Micah Williamson
|
4a083cc858
|
[ROCm][CI] Pin test_rocm_compressed_tensors_w8a8 to TRITON_ATTN (#46180)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-06-19 15:20:06 -05:00 |
|
|
Vadim Gimpelson
|
ca7e1f2c43
|
Move CI failure diagnosis docs into ci-fails-buildkite skill (#45975)
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
|
2026-06-19 20:12:40 +00:00 |
|
|
djramic
|
dec860fb19
|
[ROCm] Use vLLM's fp8 quant max in AITER hipBLASLt accuracy test (#46176)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
|
2026-06-19 13:24:02 -05:00 |
|