 Misha GoinandOpenAI Codex
|
bca7bea240
|
Remove VLLM_TEST_FORCE_FP8_MARLIN to replace with linear_backend/moe_backend (#52182)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-18 12:58:04 -04:00 |
|
|
fxmarty-amd
|
88b2bff2c6
|
[MOE] Standardize and abstract fused shared expert optimization selection (#51695)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
|
2026-08-18 12:56:56 -04:00 |
|
|
|
f9f066d195
|
[Bugfix][PaliGemma] Remove stale image embedding scaling (#52692)
Signed-off-by: jikuixie <jikuixie@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-18 16:00:55 +00:00 |
|
|
karthik
|
241ff8c443
|
[Model] Enable LoRA support for tower and connector in LlavaNextForConditionalGeneration (#49788)
Signed-off-by: gangula-karthik <gkarthik923@gmail.com>
|
2026-08-18 15:53:49 +00:00 |
|
|
Isotr0py
|
3bb9c18f0c
|
[Multimodal] Reorganize video decoder backends (#49155)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-08-18 15:06:18 +00:00 |
|
|
Wei Zhao
|
689be2bcd3
|
Upgrade Flashinfer version to 0.6.17 (#52681)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
|
2026-08-18 23:04:36 +08:00 |
|
|
|
d29dc3ab87
|
[Bugfix][Gemma4] Align parser enable_thinking default with template (#52430)
Signed-off-by: lxy-alexander <lxy_alexander@outlook.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-18 12:41:26 +00:00 |
|
|
Taneem Ibrahim
|
be3f614ff1
|
[CI] Register CPU CI "VLLM_CPU_CI_ENV" environment variable (#52633)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-18 08:28:00 -04:00 |
|
|
Bugen ZhaoandNick Hill
|
41f179b57a
|
[Rust Frontend] Simplify data-parallel size ownership (#52575)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-18 09:06:05 +00:00 |
|
|
yimdevandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
eab1cff5b0
|
Harden DeepSeek V3.2 fused kernel grids (#52381)
Signed-off-by: yimdev <5779256+yimdev@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-18 01:43:12 -07:00 |
|
|
qli88
|
e8ad2855e7
|
[Bugfix][ROCm] Fix a few int4/int8 quantization errors (#52112)
Signed-off-by: Qiang Li <qiang.li2@amd.com>
|
2026-08-18 08:31:51 +00:00 |
|
|
Yufeng He
|
5c9ff5366b
|
[Bugfix] Accept logprobs=-1 in the Completion API (#46175)
Signed-off-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com>
|
2026-08-18 08:22:13 +00:00 |
|
|
Rajath Pai
|
b01728b088
|
[Bugfix] Return 4xx for client-caused errors in /detokenize (#52622)
Signed-off-by: rajathpi <rajathpai2000@gmail.com>
|
2026-08-18 07:07:15 +00:00 |
|
|
Jee Jee Li
|
2687fec6ef
|
Replicated embedding and norm fusion for DSV3 flat model (#48484)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-08-18 14:53:21 +08:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
5fa8ca971a
|
[ROCm][CI] Move ROCm AITER quantization tests (#40938)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-18 14:50:35 +08:00 |
|
|
flb_
|
d785eb51ce
|
[Test] Add pause/resume E2E tests (#52144)
Signed-off-by: flb_ <floatlibai@gmail.com>
|
2026-08-18 14:46:44 +08:00 |
|
|
|
c89d692cb5
|
[Build] Propagate vLLM version to Rust binaries (#52593)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-17 23:37:37 -07:00 |
|
|
Yan MaandKunshang Ji
|
b0e9cff5e7
|
[XPU] update xpu-manager to v2.1.0 (#52569)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-18 06:27:41 +00:00 |
|
|
Komal Kumar TeruandCursor
|
aa9903490c
|
[Cohere] Misc changes to cohere model definitions (#50156)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-08-18 04:59:57 +00:00 |
|
|
Do_it_now_!andDo_it_now_!
|
101c4477dd
|
[Bugfix] Handle DeepseekV4ForCausalLM in benchmark_moe get_model_params (#52044)
Co-authored-by: Do_it_now_! <23432123@users.noreply.github.com>
|
2026-08-18 04:46:08 +00:00 |
|
|
|
e0e5a7fb28
|
[Rust Frontend] Fix GLM-5.2 chat template rendering parity (#51426)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-08-18 03:16:54 +00:00 |
|
|
ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟
|
d5f5de7a7d
|
[Bugfix] Fix DeepSeek V4 mHC broadcast buffer for weight sync (#52626)
Signed-off-by: Hollow Man <hollowman@opensuse.org>
|
2026-08-18 10:55:37 +08:00 |
|
|
Qiming ZhangandKunshang Ji
|
f4b161d7fc
|
[XPU][UT] Fix OOM and skip graph case (#49287)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
Signed-off-by: Qiming Zhang <qiming1.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-18 09:47:35 +08:00 |
|
|
|
69d3335066
|
[Bugfix][Quantization] Guard the MXFP8 FlashInfer path on FlashInfer availability (#52648)
Signed-off-by: Han Li <han.li124@imperial.ac.uk>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-08-17 18:38:42 -07:00 |
|
|
kiroxu
|
cdb8545a91
|
[Kernel][Perf] Support Qwen head ratios in fused GDN MTP (#52539)
Signed-off-by: kiroxu <148877251+BabyDrangoner@users.noreply.github.com>
|
2026-08-17 18:17:40 -07:00 |
|
|
Bo Liandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
c296851a7d
|
[MoE] Refine FlashInfer one-sided All2All integration (#51924)
Signed-off-by: Bo Li <22713281+bobboli@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-18 00:18:14 +00:00 |
|
|
|
0db502c8d8
|
[Kimi-K3] support DCP partial prefix cache hit (#50493)
Signed-off-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-08-17 17:05:51 -07:00 |
|
|
Kunshang Ji
|
0e8989b416
|
[ROCm] gaurd on_gfx1250 call with rocm platform (#52625)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-08-18 08:05:48 +08:00 |
|
|
Tommy AsaiandRoger Wang
|
58aa1e3d26
|
[Bugfix][SM120][MLA] Disable dense prefill for FlashInfer sparse MLA (#51395)
Signed-off-by: tommy-asai-sonarsource <yosuke.asai@sonarsource.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
|
2026-08-17 16:58:02 -07:00 |
|
|
Jakub ByczkowskiandCopilot
|
c296cf8259
|
[Bugfix] Add forward_xpu to XDRotaryEmbedding for HunyuanOCR on XPU (#52174)
Signed-off-by: Jakub Byczkowski <jakub.byczkowski@intel.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
|
2026-08-18 07:54:05 +08:00 |
|
|
Divakar Verma
|
49fb2ee348
|
[ROCm][CI] add Aiter ops tests (#52208)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
|
2026-08-17 18:33:22 -05:00 |
|
|
|
5ae2d38821
|
[Perf][Structured Output] Skip unused request-local reasoners (#52573)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-17 16:30:41 -07:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
60c3a31b12
|
[CI][AMD] Improve Kubernetes failure diagnostics (#52264)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-17 18:09:12 -05:00 |
|
|
Canlin GuoandNick Hill
|
455edc022b
|
[ModelRunnerV2] Support prompt embeds (#42963)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Signed-off-by: Canlin Guo <961750412@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-17 21:58:50 +00:00 |
|
|
Hongxia YangandAndreas Karatzas
|
e68fb75b25
|
[ROCm][AMD][Installation] add LMCache kv-connector installation and runtime packages to docker image (#51208)
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-17 16:58:48 -05:00 |
|
|
Micah Williamson
|
8878ebd8fd
|
[ROCm][CI] Expand AITER W4A4 MoE Coverage (#52647)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-08-17 15:46:22 -05:00 |
|
|
Connor Carpenterandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
f08a95f8d8
|
[Rust Frontend][gRPC] Advertise LoRA capabilities (#52031)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-17 13:27:56 -07:00 |
|
|
Wei Zhao
|
d1e3eee6fb
|
[Spec decode] Support Kimi-K3 DCP with DSpark (#52188)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
|
2026-08-17 13:08:45 -07:00 |
|
|
|
9633933dd8
|
Relax CuPy constraint to only exclude 14.1.0 (#44284)
Signed-off-by: khluu <kevin@inferact.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: khluu <kevin@inferact.ai>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-17 19:41:09 +00:00 |
|
|
crZhao
|
3fc2893909
|
[Bugfix] Account for local DP workers in startup thread allocation (#52385)
Signed-off-by: real-cpu <zhaochenrui757@gmail.com>
|
2026-08-17 12:10:34 -07:00 |
|
|
Andreas Karatzasandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
c1e438728c
|
[ROCm][CI] Restore Torch defaults and type DSV4 scratch buffers (#52566)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-17 18:32:04 +00:00 |
|
|
|
75dde08d3f
|
[Perf][MoE] Optimize deepep_v2 receiver CPU Overhead (#51114)
Signed-off-by: Lucas Wilkinson <wilkinson.lucas@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
|
2026-08-17 18:21:32 +00:00 |
|
|
stefankoncarevicandAndreas Karatzas
|
402547d7f0
|
[Bugfix][CI] Release the shared ColBERT engine before test_colbert_hf_comparison (#52608)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-08-17 17:50:26 +00:00 |
|
|
Juan Pérez de Algaba
|
ceb340e2eb
|
fix: prevent PyNvVideoCodec decoder slot limit bypass via ClassVar shadowing (#52126)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-08-17 17:45:40 +00:00 |
|
|
ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟
|
cfbc5afbf7
|
[BugFix] lora_base_layer / routed_experts order in expert param mapping (#52552)
Signed-off-by: Hollow Man <hollowman@opensuse.org>
|
2026-08-17 17:40:51 +00:00 |
|
|
Roberto L. CastroandCodex
|
49905ad94d
|
[3/N][Feat][Perf] Add new warmup infrastructure for JITs. Add provider registry and orchestration for JIT warmup (#50174)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-08-17 10:11:14 -07:00 |
|
|
Misha Goin
|
7075ddac28
|
Support DSpark configs with architectures=DSparkDraftModel + model_type=qwen3 (#52197)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-17 12:48:30 -04:00 |
|
|
Misha Goin
|
4ab5e5012a
|
[Refactor] Simplify B12X linear kernels and warmup (#52368)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-08-17 09:45:45 -07:00 |
|
|
Tyler Michael SmithandOpenAI Codex
|
017e9f4448
|
Promote prefix_cache_retention_interval to an argument and change the default to 0 (#52216)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-08-17 13:20:50 +00:00 |
|
|
qli88
|
1d3a8b9e22
|
[ROCm][Bugfix] Fix Triton W4A16 bug in determining if transpose is required for GPTQ/AutoGPTQ (#48998)
Signed-off-by: Qiang Li <qiang.li2@amd.com>
|
2026-08-17 12:26:05 +00:00 |
|