Commit Graph - vLLM - iHore Software Repository

iHore/vLLM

Fork 0

77e1c035d0 [chore][LMCache connector] Remove useless logs from lmcache connector (#29069) Yihua Cheng 2025-11-21 19:18:00 -08:00
6f403501a0 [CI/Build][AMD] Enable Entrypoints Integration Test (Pooling) to run without error on ROCm (#29212) rasmithandRandall Smith 2025-11-21 20:13:18 -06:00
052950e5b3 Add fused MoE config for H200 E160 N192 fp8 (#29182) FlintyLemming 2025-11-22 09:37:51 +08:00
1ef9c9e294 [CI/Build] Disable test_gptoss_tp.py in 'LoRA TP Test' group for ROCm platform (#29204) qli88 2025-11-21 19:36:19 -06:00
5c8f2adf50 [Bugfix] Fix block size in block_table with PCP (#29094) Jie Luo 2025-11-22 09:34:28 +08:00
ed8e6843cc [CI/Build] Add terratorch for AMD (#29205) Ryan Rock 2025-11-21 19:31:22 -06:00
d045e22dfe [Model][Qwen3VL] Tune Triton w8a8 block fp8 kernel for L40s (#29217) Lukas Geiger 2025-11-22 01:30:55 +00:00
1d34eb11e0 [CI] Bug: Fix triton import issue (#29202) Wentao Ye 2025-11-21 20:14:49 -05:00
9a3101b2ba [Rocm][CI] Fix DeekSeek V2-Lite Accuracy CI (#29135) Charlie Fu 2025-11-21 19:11:02 -06:00
d5dbdbfcb2 [docs] Fix cudagraph mode config (#29170) Angela Yi 2025-11-21 17:10:27 -08:00
30d6466238 [BugFix] Fix Eagle IndexError: list index out of range for even num_speculative_tokens (#29102) Lucas Wilkinson 2025-11-21 19:47:05 -05:00
e9af6ba62a [Model Runner V2] Optimize Gumbel Sampling Kernel (#29210) Woosuk Kwon 2025-11-21 15:52:28 -08:00
c6fa3895e9 [KV Connector] Fix async connector prefix cache metrics (#28585) Mark McLoughlinandNicolò Lucchesi 2025-11-21 22:45:00 +00:00
3137991f55 [BugFix] EPLB + B200 + DeepGEMM : Handle column-major scales tensor (#29162) Varun Sundar RabindranathandVarun Sundar Rabindranath 2025-11-21 17:28:17 -05:00
57430fc95c Default model load/config/tokenizer to mistral format if relevant files exist (#28659)
Julien Denizegemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>mgoin
2025-11-21 22:58:59 +01:00
c68c7b403d [BugFix] Fix missing symbol triggering FA2 fallback on Hopper (#29107) Lucas Wilkinson 2025-11-21 16:58:32 -05:00
53a1ba6ec5 [log] add weights loading time log to sharded_state loader (#28628) Ning Xie 2025-11-22 05:06:09 +08:00
1840c5cb18 [BugFix] Make sure to allocate worst case MoE workspace during profile run in the DP + EP case (#27426) Lucas Wilkinson 2025-11-21 14:41:52 -05:00
1bed891f72 [Chore] Fix pre-commit error after #25266 (#29190) Woosuk Kwon 2025-11-21 10:21:40 -08:00
ceca060501 [Deprecation] Deprecate seed=None (#29185) Cyrus Leung 2025-11-22 02:19:25 +08:00
75648b16dd [ROCm][CI] Fix config/test_config_generation.py (#29142) Charlie Fu 2025-11-21 11:12:16 -06:00
460d02a417 [NIXL] Fix after virtual block_size for host_buffer with heter kv_layout (#29122) Chendi.Xue 2025-11-21 10:55:27 -06:00
b4c8fbaae2 Add TRTLLM MoE NVFP4 kernel to CompressedTensorsW4A4MoeMethod (#28892) Mingyuan Maandmgoin 2025-11-21 08:54:11 -08:00
e99e467384 [CI/Build][Kernel][AMD] Move extra dim to after load in _fwd_kv_parallel in lighting_attn.py (#29132) rasmithandRandall Smith 2025-11-21 10:53:09 -06:00
a42ab317ac [Log] Optimize startup log (#28948) Wentao YeandNick Hill 2025-11-21 11:46:20 -05:00
b7f1f490a6 Upstream triton fp4 weight preshuffle (#28888) Aleksandr MalyshevandAleksandr Malyshev 2025-11-21 08:34:46 -08:00
30b44a1598 GPU Model Runner V2 (#25266) Woosuk Kwon 2025-11-21 08:20:55 -08:00
1f400c58b8 [CI] Add batch invariant test to ci (#27842) Wentao Ye 2025-11-21 11:20:33 -05:00
711241c13c [CI/Build] Fix illegal memory access and unsupported test in kernels/attention/test_cache.py (#29118) rasmithandRandall Smith 2025-11-21 09:58:38 -06:00
d7219bcda3 [Misc] Move dynamic seed initialization to EngineArgs (#29165) Cyrus Leung 2025-11-21 23:27:44 +08:00
4050bae417 [Doc] Update plugin doc (#28532) wangxiyuan 2025-11-21 22:57:26 +08:00
f1805db1a6 [Perf] These changes enhance the NUMA functionality of vllm for systems with more than one NUMA nodes per socket (#25559) skaraban3807 2025-11-21 19:43:52 +05:30
434f3d3eb8 Fix mistral config (#29172)
Julien Denizegemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Patrick von Platen
2025-11-21 15:01:20 +01:00
2092ce8c39 Tool Call Parser logs should not contain user input / model output except on DEBUG (#29160)
sfbemerk Benjamin Merkel Chauncey
2025-11-21 13:57:19 +01:00
fc9f821d20 fix cross attention (#28346) who who who 2025-11-21 20:55:43 +08:00
9452863088 Revert "Revert #28875 (#29159)" (#29179) Cyrus Leung 2025-11-21 20:27:43 +08:00
2b1b3dfa4b Update Dockerfile to use gcc-toolset-14 and fix test case failures on power (ppc64le) (#28957) Bhagyashri 2025-11-21 17:54:09 +05:30
cca2d2cdbe [Core] Align whisper closer to other multimodal models (#27292) Russell Bryant 2025-11-21 07:01:54 -05:00
aab0102a26 [V0 deprecation] Remove more V0 references (#29088) Cyrus Leung 2025-11-21 19:56:59 +08:00
b34129bf8e [Misc] remove useless v1 env (#29164) WeiQing Chen 2025-11-21 17:41:20 +08:00
4d7231e774 Revert #28875 (#29159) Cyrus Leung 2025-11-21 17:40:17 +08:00
8ac3a41487 [CI Failure] Fix Gemma3 RoPE configuration for sliding attention layers (#29111)
Huamin Li Harry Mellor Cyrus Leung
2025-11-20 23:53:30 -08:00
7d6da483b0 [Minor][Clean] Remove the legacy assertion in video (#29150) Canlin Guo 2025-11-21 15:52:34 +08:00
e4c3182c68 [Small] Capture AttributeError when checking ray dependency. (#29024) Chenheli Hua 2025-11-20 22:54:10 -08:00
b4734b9550 [Bugfix] Fix default MM LoRA alignment for single str prompts (#29140) Alex Brooks 2025-11-20 22:32:30 -07:00
30b9c67743 Revert "[Redo] #26368 (#28771)" (#29121) Jialin Ouyang 2025-11-20 21:27:45 -08:00
11857a00b0 [Attention] Add ROCM_AITER_MLA_SPARSE to attention backend registry (#29103) Matthew Bonanni 2025-11-20 23:24:43 -05:00
8c25f9cfb6 [BugFix] skip combo kernel on cpu (#29129) Boyuan Feng 2025-11-20 19:50:59 -08:00
56e96b37e4 [V0 Deprecation] Remove best_of (#29090) Cyrus Leung 2025-11-21 11:40:40 +08:00
698024ecce [Doc] update installation guide regarding aarch64+cuda pytorch build (#28875) Qidong SuandCyrus Leung 2025-11-20 22:40:25 -05:00
0730414999 [Core] Add audio_embeds support to chat completions (#29059) jeremyteboulandJeremy Teboul 2025-11-20 19:39:47 -08:00
a982f5b5ea [kernel][perf] support uncontiguous input for rms_norm kernel (#28103) zhrrrandWentao Ye 2025-11-21 11:39:09 +08:00
0e741c12e3 [Bugfix] Fix Plamo3 rope handling (#29092) Cyrus LeungandHarry Mellor 2025-11-21 11:38:35 +08:00
56669c1f29 [CI] Fix mypy for vllm/v1/worker (#29037) Wentao Ye 2025-11-20 22:36:07 -05:00
3f5f36da3f [ROCm] Fix for import when building with upstream triton for gfx1100 for gpt-oss serving (#29127) Hongxia Yang 2025-11-20 22:30:07 -05:00
e1eefa4c40 [Bug] Fix torch warning of tf32 usage (#29112) Wentao Ye 2025-11-20 20:54:59 -05:00
ed6ae1e36a [AITER] [ROCm] Fix crash when loading llama4 model with old aiter version installed, fallback to forward_native implementation (#29124) Xiao Li 2025-11-20 17:54:35 -08:00
9875be6431 [LoRA][2/2]Remove LoRA extra vocab (#28545) Jee Jee Li 2025-11-21 09:46:43 +08:00
df44df0143 [Feature] Shared Experts Overlap with FI deepgemm swap kernel, 2.2% throughput improvement and 3.6% TTFT improvement (#28879) Wentao Ye 2025-11-20 20:41:49 -05:00
87cbbdff63 Update model references for OLMo3 (#29099) Michael GoinandCyrus Leung 2025-11-20 20:16:52 -05:00
986ab5db63 [CI Bugfix] Fix Kernels DeepGEMM Test (H100) (#29106) Michael Goin 2025-11-20 19:42:33 -05:00
dd39f91edb [Doc] cleanup TPU documentation and remove outdated examples (#29048) Rob MullaandHarry Mellor 2025-11-20 19:05:59 -05:00
c7a29d2c8d [CI/Build] Remove skip global cleanup in test_struct_output_generate.py (#29022) rasmithandRandall Smith 2025-11-20 15:44:37 -06:00
8237ab8a2b [CI/Build] Skip lm-format-enforcer tests in test_struct_output_generate.py for now (#29021) rasmithandRandall Smith 2025-11-20 15:35:14 -06:00
3fd74189db Fixes bench (#29058) Driss Guessous 2025-11-20 13:21:54 -08:00
5e5a7eb16f [CI/Build] Make test_attention_selector.py run tests on correct platform (#29064)
rasmith Randall Smithgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-11-20 14:45:56 -06:00
3d84ef9054 [CI/Build][AMD] Skip if flash_attn_varlen_func not available in test_aiter_flash_attn.py (#29043) rasmithandRandall Smith 2025-11-20 14:39:49 -06:00
4d01b64284 [Bugfix] - Add Trace Headers to Beam Search Path (#29100) Software Developer 2025-11-20 21:00:33 +01:00
114b0e2500 [chore] Update annotate release scripts (#29077) Kevin H. Luu 2025-11-20 10:22:40 -08:00
647464719b [KVConnector][Core] Support cross-layer KV blocks (#27743) Or Ozeri 2025-11-20 20:09:59 +02:00
e5bfcb6a88 [BugFix][PD]: make example proxy usable with P2pNcclConnector (#26628) Pan Li 2025-11-21 01:38:31 +08:00
22924383e1 Updating the mirror of test-amd.yaml as of 2025-11-18 (#29016) Alexei-V-Ivanov-AMD 2025-11-20 11:07:06 -06:00
56f45eddaf [Frontend] Optimize beam search loop by sorting and then splicing (#19347)
rookie zhangguozhu mgoin
2025-11-21 01:02:30 +08:00
82b05b15e6 [BugFix] [FEAT] Enable fastsafetensors for ROCm platform (#28225) TJian 2025-11-20 23:34:11 +07:00
a2e9ebe9e2 [BugFix] Fix flash_attn import in siglip2navit.py (#29082) Fanli Lin 2025-11-20 20:14:29 +08:00
93c8672ceb [Bugfix] Fix spec decode memory regression after #28549 (#28819) Zhewen Li 2025-11-20 03:05:50 -08:00
371b1d4c61 [RL] Add Pause and Resume Generation for Asynchronous RL Training (#28037) Samitand22quinn 2025-11-20 19:01:03 +08:00
c9e093116c [MODEL] Implement plamo3 (#28834) Shinichi Hemmi 2025-11-20 20:00:19 +09:00
c0c2dd1e0b [BugFix] kv_offloading: Fix bug in loading of partial cpu blocks (#28951) Or OzeriandCyrus Leung 2025-11-20 12:55:10 +02:00
06c20c9904 [ROCm] Add AMD GPU support on Deepseek v3.2 and SparseMLA (#26670) Pleaplusone 2025-11-20 18:54:01 +08:00
6eb745d9bd Add truncate arg to yarn to match openai implementation of gpt-oss (#28244) Anna ShorsandChen Zhang 2025-11-20 02:53:50 -08:00
66483a9d00 [Chore] Update xgrammar version from 0.1.25 to 0.1.27 (#28221) cjackal 2025-11-20 19:53:09 +09:00
edfe867208 [Misc] don't cache CUTLASS_REVISION var in CMakeLists.txt (#28518) Jinzhen LinandLucas Wilkinson 2025-11-20 18:52:53 +08:00
dc45efc8ef [BugFix] Fix Llama4 Pipeline Parallelism Assert Error (#28577) DezhanandDezhan Tu 2025-11-20 02:52:36 -08:00
fb8851f254 [Bugfix][cache_kernels]: Fix OOB in cache_kernels.cu (#28760) Vensen 2025-11-20 18:52:02 +08:00
a903d59ffa cleanup at::Tag::needs_fixed_stride_order (#28974) Boyuan FengandCyrus Leung 2025-11-20 02:51:36 -08:00
322cb02872 [CI/Build][AMD] Fix import errors in tests/kernels/attention (#29032) rasmithandRandall Smith 2025-11-20 03:48:09 -06:00
2c52c7fd9a [Bug] Fix torch dynamo warning Dynamo detected a call to a functools.lru_cache (#29038) Wentao Ye 2025-11-20 03:52:23 -05:00
1e1c06789e [ci][amd] fix EPLB execution test (#28742) Bradley D 2025-11-19 23:53:38 -08:00
7218f83992 [ROCm][BugFix] Fix shared expert loading error when disable VLLM_ROCM_USE_AITER_FUSION_SHARED_EXPERTS (#28633) Pleaplusone 2025-11-20 15:50:23 +08:00
20e4497be2 [V0 Deprecation] Remove num_lookahead_slots (#29000) Cyrus LeungandMichael Goin 2025-11-20 14:39:10 +08:00
1c7bcc55b8 [Frontend] Allow parsed tool arguments (#28820) Quentin Gallouédecandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2025-11-19 23:20:12 -07:00
a9705a290a [Model][QwenVL] Replace torch.repeat_interleave with faster np.repeat (#28964) Lukas Geiger 2025-11-20 06:04:23 +00:00
64192d5624 [Bugfix] Revert custom attention mask for gemma3-mm (#28995) Isotr0pyandCyrus Leung 2025-11-20 13:23:22 +08:00
fe25772aa9 [Bugfix] Handle broken frames in video loading (#29001) Canlin Guoand凌葭 2025-11-20 12:38:12 +08:00
0cca9b4d13 [Bugfix] Fix precision loss in LoRA-wrapped RowParallelLinear by fusing bias into GEMM (#28972) prashanth058 2025-11-19 19:50:37 -08:00
a8c536829c Consolidate Nvidia ModelOpt quant config handling for all quantization methods (#28076) Shengliang Xu 2025-11-19 19:39:36 -08:00
fcbcba6c70 [Feat] Iteration-level profiling for Torch and CUDA profiler (#28987) Benjamin Chislettandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2025-11-19 22:17:48 -05:00
3168285fca [cpu][ci] Add initial set of tests for Arm CPUs (#28657) Fadi Arafeh 2025-11-20 02:37:09 +00:00
3fb0d90999 [AMD] Use Decoupled Kernel Block Size to Support AITER MLA block_size=1 (#27715) Qiang Zhang 2025-11-20 10:11:52 +08:00

... 117 118 119 120 121 ...

Commit Graph Select branches Hide Pull Requests main patches sm86 Mono Color

Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86