Commit Graph - vLLM - iHore Software Repository

iHore/vLLM

Fork 0

ff1f83b056 [Refactor] Replace activation: str with MoEActivation enum (#33843) Michael Goin 2026-02-11 20:29:32 -05:00
83b47f67b1 [ci] Integrate AMD tests into CI (#33626) Kevin H. LuuandTJian 2026-02-11 16:54:17 -08:00
fb7b30c716 [ROCm][CI] Revert Test Groups From mi325_8 to mi325_1 Agent Pool In AMD CI (#34384) Micah Williamson 2026-02-11 17:52:34 -06:00
31d992d215 [Bugfix] Fix some issues with MoERunner PR #32344 (#34371) bnellnm 2026-02-11 17:33:14 -05:00
5aff2699bd Fix CI failure - Flashinfer Kernel tests (#34316) Wei Zhao 2026-02-11 17:17:16 -05:00
527ca32197 [Bugfix] Fix more multimodal tests for transformers V5 (#34334) Raushan Turganbay 2026-02-11 22:02:05 +01:00
5458eb835d [Bugfix] send None sentinel on final commit so server properly sends transcription.done (#33963) Junseo ParkandNick Hill 2026-02-12 06:01:53 +09:00
144d9b7cc8 [Benchmarks] Reduce ready checker log verbosity (#34349) Tomas Ruiz 2026-02-11 21:57:57 +01:00
83e26c834e [GPT-OSS] Remove unnecessary contiguous (#34337) elvischenv 2026-02-12 04:29:29 +08:00
5001211369 [ROCm] [CI] fix test_unrecognized_env (#34350) TJian 2026-02-12 02:50:44 +08:00
11c7ace340 [Bugfix] Enable attn quantization of Llama-4 by correctly permuting scales for rope (int8, fp8) (#34243) Eldar KurtićandYour Name 2026-02-11 19:24:22 +01:00
be7f3d5d20 [Bugfix] fix default is_neox_style is True for deepseek (#34353) Xinyu Dong 2026-02-12 02:20:45 +08:00
0ab06100f4 [Multimodal] Expose mm_processor_kwargs for DummyInputsBuilder (#34330) Isotr0py 2026-02-12 01:37:40 +08:00
ffb3d553cc [Model Runner V2] Init cuda graph pool when necessary (#33217) Xinyu Chen 2026-02-12 01:12:13 +08:00
fa7e0bfacf [CI][BugFix] Fix silent failure in shellcheck hook and baseline exist… (#32458) junuxyz 2026-02-12 02:03:48 +09:00
48134a2c22 [Docs] Fix typo ("defult") and double spacing (#34348)
SorenDreano Soren Dreanogemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-11 18:02:27 +01:00
64f570ab56 [ROCm] [aiter] Split KV cache update for AiterFlashAttention (#33681) kliuae 2026-02-12 00:26:44 +08:00
fd618871b4 [Bugfix]: Fix ROCm fusion attn test; use AttentionBackend utils to create kv cache (#33948) Rohan Potdar 2026-02-11 10:12:05 -06:00
67a42b5a44 Don't try and run GLM-ASR with remote code (#34352) Harry Mellor 2026-02-11 17:09:40 +01:00
c7914d30f9 Reapply [Attention][FA3] Update FA3 to include new swizzle optimization (#34043) Lucas Wilkinson 2026-02-11 08:07:56 -07:00
1b8756562e Responses harmony system message structured (#34268) Adam Binford 2026-02-11 08:14:28 -05:00
275e0d2a99 [NVIDIA][test] Tests for flashinfer TRTLLM BF16 MoE (#33715) LindaandPavani Majety 2026-02-11 13:38:11 +01:00
0f5e55e7a8 Make JAIS compatible with Transformers v5 (#34264) Harry Mellor 2026-02-11 13:30:37 +01:00
1e9204bff3 Make Qwen3VL compatible with Transformers v5 (#34262) Harry MellorandRoger Wang 2026-02-11 13:13:23 +01:00
05339a7b20 [Bugfix][CPU] Fix llama4 inference on CPU (#34321) Li, Jiang 2026-02-11 19:07:23 +08:00
40b8f55358 [Docs] Reduce time spent generating API docs (#34255) Harry Mellor 2026-02-11 11:56:02 +01:00
5045d5c983 Patch protobuf for CVE-2026-0994 (#34253) Seiji EicherandKevin H. Luu 2026-02-11 02:25:04 -08:00
e09546cf05 [Frontend] Exploit tokenizers "new stream" in FastIncrementalDetokenizer (#34217) Nick Hill 2026-02-11 02:03:24 -08:00
786806dd44 [Doc] Update Marlin support matrix for Turing (#34319) Tianqi Ren 2026-02-11 17:03:41 +08:00
79504027ef [Misc] Bump fastsafetensors version for latest fixes (#34273) Nick Hill 2026-02-11 00:30:09 -08:00
addac0e653 [torch.compile] Enable AR+rms fusion by default available for -O2 (#34299) Luka Govedič 2026-02-11 03:30:00 -05:00
675a22ed66 [Chore] Move BaseRenderer to base.py (#34308) Cyrus Leung 2026-02-11 16:29:51 +08:00
cb9574eb85 [XPU][9/N] clean up existing ipex code/doc (#34111) Kunshang Ji 2026-02-11 16:27:15 +08:00
21dfb842d7 [model] support FunASR model (#33247) AllenDouandzixiao 2026-02-11 15:37:09 +08:00
d1b837f0ae [CPU] Enable FP16 (Half dtype) support for s390x (#34116) R3hankhan 2026-02-11 12:11:42 +05:30
0b20469c62 [Bugfix] Fix weight naming in Qwen3.5 (#34313) Roger Wang 2026-02-10 21:37:14 -08:00
d7982daff5 [Bugfix] Fix fused MoE IMA (sans chunking) by using int64 for strides (#34279) Tyler Michael SmithandClaude Opus 4.6 2026-02-11 00:15:52 -05:00
9b17c57460 [ModelBash][DSR1 NVFp4] Removed Bf16 Bias Cast (#34298) Robert ShawandRobert Shaw 2026-02-11 00:00:00 -05:00
1b3540e6c6 Threshold fix wvSplitk for occasional CI fails (#34013) Hashem Hashemi 2026-02-10 19:59:14 -08:00
7a048ee65f [Bugfix] Fix benchmark_moe.py inplace assertion with torch >= 2.9 (#34149) Matthias Gehre 2026-02-11 04:58:56 +01:00
c9a1923bb4 [Plugin] Simplify IO Processor Plugin interface (#34236) Cyrus Leung 2026-02-11 11:47:39 +08:00
b482f71e9f [XPU][7/N] enable xpu fp8 moe (#34202) zofia 2026-02-11 11:33:59 +08:00
1485396abb [Kernel] Apply 256bit LDG/STG To Activation Kernels (#33022) Дзержи́нскийandWentao Ye 2026-02-11 11:31:51 +08:00
5ee5c86eeb [Bugfix][DeepSeek-V3.2] fix fp8 kvcache type cast (#33884) Kebe 2026-02-11 12:31:36 +09:00
b5dcb372e4 [Misc] Clean up validation logic in input processor (#34144) Cyrus Leung 2026-02-11 11:29:29 +08:00
066c6da6a0 [WideEP] Fix nvfp4 DeepEP High Throughput All2All backend (#33738) Tyler Michael SmithandRobert Shaw 2026-02-10 22:15:43 -05:00
e30cedd44b [torch.compile] Stop doing unnecessary FakeTensorProp in PiecewiseCompileInterpreter (#34093) Richard Zou 2026-02-10 22:15:40 -05:00
3bcd494ef4 [Redo] Add --trust-remote-code to dataset bench args (#34251) Cyrus Leung 2026-02-11 11:10:12 +08:00
0e725a7d22 [Bugfix] Fix Worker.load_model context-manager composition for sleep mode (#34021) tianshu-Michael-yu 2026-02-10 19:07:51 -08:00
ba0511fd80 [Misc] Add run one batch script that supports profiling (#32968) Lucas Wilkinson 2026-02-10 19:29:49 -07:00
4a1550d22d [ROCm][CI] Fix test_sequence_parallel.py location in AMD CI pipeline (#34280) Micah Williamson 2026-02-10 19:08:11 -06:00
d1481ba783 [MoE Refactor] Introduce MoERunner abstraction and move execution logic from FusedMoE to DefaultMoERunner (#32344) bnellnm 2026-02-10 19:51:07 -05:00
dc6de33c3d [CI] Add pip caching to cleanup_pr_body workflow (#32979) 7. Sun 2026-02-11 08:45:28 +08:00
c4b9e6778f [Misc] Add pre-commit hook to catch boolean ops in with-statements (#34271) Tyler Michael SmithandClaude Opus 4.6 2026-02-10 18:13:20 -05:00
341eed3d30 [torch.compile] Disable recursive pre_grad_passes (#34092) Richard Zou 2026-02-10 18:02:31 -05:00
6f2f59f2b3 [Misc][Spec Decode] support different load config for draft model (#34022) Zhengkai Zhangandzzhengkai 2026-02-10 14:52:43 -08:00
bb2fc8b5e7 [BugFix] Fix async EPLB hang with DeepEP LL all2all backend (#32860) Ilya Markov 2026-02-10 23:34:47 +01:00
67132945bb [Perf] Move eplb rebalance algo to async thread (#30888)
Ilya Markov Tyler Michael Smith Tyler Michael Smith
2026-02-10 23:19:10 +01:00
f0ca0671c7 [Feature] Warn about unrecognized environment variables (#33581) Gregory Shtrasberg 2026-02-10 15:45:38 -06:00
578977bb5e [SM100] Resubmit FMHA FP8 prefill for MLA (#31195) Pavani Majety 2026-02-10 13:18:43 -08:00
9615575afc [Bugfix] Fix mamba cache dtype for Qwen3.5 (#34200) Roger Wang 2026-02-10 13:12:31 -08:00
4293c00b84 [Benchmarks] Fix attention benchmark smoke test (#34269) Matthew Bonanni 2026-02-10 16:04:07 -05:00
506ad7d7c1 [Bugfix] Fix weights offloading for sleep mode (#32947) J SeppänenandTyler Michael Smith 2026-02-10 22:38:17 +02:00
fdd6f2ad58 Convert online APIs to use Renderer (#34084) Reagan LeeandReagan Lee 2026-02-10 11:44:31 -08:00
33bcd3dc3b [Misc] Introduce ec_both role EC (encoder cache) connector (#34182) Qi Wang 2026-02-10 10:55:35 -08:00
1f5febb4b8 [UX nit] Fix non-default api_server_count message (#34152) Michael Goin 2026-02-10 13:35:58 -05:00
ae871ca923 Minor cleanup for Voxtral (#34247) Andy Lo 2026-02-10 18:18:30 +00:00
a2443de5fa [Model Runner V2] Use pinned memory for write_contents (#34222) Woosuk Kwon 2026-02-10 08:55:22 -08:00
f84a2a8f31 [Docs] Speed up build environment set-up (#34240) Harry Mellor 2026-02-10 17:34:43 +01:00
000214c4bb [BUGFIX] Fix accuracy bugs in Qwen3-Next MTP (#34077) Vadim Gimpelson 2026-02-10 19:57:11 +04:00
c5a66d1697 [Core][BugFix] Fix PP KV cache sharding memory validation (#33698) junuxyz 2026-02-11 00:46:24 +09:00
afdce12c89 [Perf][Kernel] Add faster topKperRow decode kernel for DeepSeek-V3.2 sparse attention (#33680) Roberto L. CastroandClaude Sonnet 4.5 2026-02-10 16:29:52 +01:00
82e11973cc [compile] Enable AOT compile with 2.10 in trunk. (#34155) Zhengxu Chen 2026-02-10 10:24:42 -05:00
b129136c7a [ROCm][Quantization] GPT_OSS in amd-quark format model loading and emulations (#29008)
xuebwang-amd Robert Shaw Robert Shaw
2026-02-10 23:08:05 +08:00
599e4335a4 Support benchmarking of Geospatial models (#33922) mgazz 2026-02-10 15:04:16 +00:00
a1946570d8 add --insecure arg to the vllm bench to skip TLS (#34026) Fan YangandFan Yang 2026-02-10 06:23:52 -08:00
d0bc520569 Bump mamba-ssm version in CI for Transformers v5 compatibility (#34233) Harry Mellor 2026-02-10 14:46:01 +01:00
748625cdaf [V1][BugFix] Fix EAGLE3 encoder cache miss with disable_chunked_mm_input (#34220) Krish Gupta 2026-02-10 18:35:32 +05:30
61413973e8 Stop testing for slow tokenizers as they will not exist soon (#34235) Harry Mellor 2026-02-10 13:08:20 +01:00
94de871546 [Misc] allow specify is_mm_prefix_lm in hf_config (#34215) Phúc H. Lê Khắc 2026-02-10 18:16:21 +07:00
e042d7e685 Add flagos in MiniCPM-o (#34126) tc-mbandVincent-Xiao 2026-02-10 18:51:48 +08:00
ae4e280602 [Bugfix] Fix FI kernelchunk_gated_delta_rule output shape for Qwen3.5 (#34219) Roger Wang 2026-02-10 02:41:24 -08:00
cbea11c9f0 [Docs] Fix format error in KV load failure recovery doc (#34137) zzaebok 2026-02-10 18:16:26 +08:00
2c32558a3c [Bugfix] Fix --trust-remote-code conflict (#34218) Cyrus Leung 2026-02-10 16:29:10 +08:00
5f970120f0 [Bugfix] Fix memory inconsistency in cross-process shared memory (#32022) Zetong Li 2026-02-10 16:22:03 +08:00
998e2d91f8 Revert #34208 (#34216) Cyrus Leung 2026-02-10 15:59:04 +08:00
e1060a71a1 [Perf] Optimize detokenizer python logic (#32975) Wentao YeandNick Hill 2026-02-10 02:54:41 -05:00
97fa8f6590 [BugFix] Avoid prefix cache hit in the same schedule step for mamba layers (#29387) Chen Zhang 2026-02-09 23:41:16 -08:00
dab1de9f38 [Frontend][CI] Consolidate instrumentator entrypoints (#34123) wang.yuqi 2026-02-10 15:30:19 +08:00
8d48d0a9d9 [Bugfix] Sort hf_weights_files in fastsafetensors_weights_iterator to match #33491 (#34190) Balaxxe 2026-02-10 00:06:30 -07:00
9608844f96 [responsesAPI] fix simpleContext streaming output_messages (#34188) Andrew XiaandAndrew Xia 2026-02-09 22:53:07 -08:00
f69b903b4c [Bugfix] Add --trust-remote-code to dataset bench args (#34208) Cyrus Leung 2026-02-10 14:37:50 +08:00
81e217fe6b [Bugfix] Fix DP Attention Padding in Dummy Run (#34187) Lucas WilkinsonandBenjamin Chislett 2026-02-09 21:29:39 -08:00
ab97bcf662 [CI/Build] Relax test_mcp_tool_call (#34204) Cyrus Leung 2026-02-10 13:18:57 +08:00
25e48a3aae [Doc] Update usage of --limit-mm-per-prompt (#34148) Cyrus Leung 2026-02-10 13:12:13 +08:00
8a5e0e2b2b [Bugfix][Core] Fix CPU memory leak from Request reference cycle in prefix caching (#34183) Roger Wang 2026-02-09 21:03:32 -08:00
4cde2e0159 [ROCm][Bugfix] Resolve Dynamo tracing crash from amdsmi calls in on_gfx* arch detection (#34108) Andreas Karatzas 2026-02-09 22:50:20 -06:00
047a457fa4 [Bugfix] Adopt ChunkGatedDeltaRule for Qwen3.5 (#34198) Roger Wang 2026-02-09 19:47:54 -08:00
e94ec59733 [LMCache] Token Base IPC API (#34175) Yuwei An 2026-02-09 17:18:42 -08:00
13397841ab [structured output] validate unsupported json features first (#33233)
Ning Xie Chauncey Russell Bryant
2026-02-10 07:49:09 +08:00

... 94 95 96 97 98 ...

Commit Graph Select branches Hide Pull Requests main patches sm86 Mono Color

Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86