 Harry MellorandClaude Opus 5.5
|
fc2c801ad9
|
Disable mypy arg-type and assignment checks in tests (#59428)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-30 15:18:50 +00:00 |
|
|
|
42d9f8ccdb
|
support rl feature : weight checker (#51350)
Signed-off-by: shiyuan680 <yangcheng104@huawei.com>
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: shiyuan680 <yangcheng104@huawei.com>
Co-authored-by: Ronald1995 <ronaldautomobile@163.com>
Co-authored-by: DeepSeek Harness <noreply@deepseek.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
|
2026-09-30 03:13:43 +00:00 |
|
|
|
f5ed3d9c03
|
[Fast Start] Charge daemon-held weights against gpu_memory_utilization (#57298)
Signed-off-by: liusy58 <mg21330037@smail.nju.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: Xun Sun <UNIDY2002@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Xun Sun <UNIDY2002@outlook.com>
|
2026-09-29 17:58:35 +00:00 |
|
|
|
af5b4857e1
|
[Fast Start] Support PP (#55477)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Xun Sun <UNIDY2002@outlook.com>
|
2026-09-29 09:37:43 +00:00 |
|
|
Xun SunandIsotr0py
|
e7900156e1
|
[Fast Start] Add /health endpoint for the weight cache daemon (#58552)
Signed-off-by: Xun Sun <UNIDY2002@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-27 17:48:54 +00:00 |
|
|
Isotr0py
|
24928a4d62
|
[UX][Frontend] Introduce vllm preload cli for fast restart (#56680)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-25 06:56:39 +00:00 |
|
|
|
90a9515006
|
[Cleanup] Remove online quantization support in fp8.py in favor of online shorthands (#53585)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-09-24 12:48:14 -07:00 |
|
|
Xun Sun
|
e773247f8a
|
[Fast Start] Wait for weight cache daemon readiness (#58370)
|
2026-09-24 19:18:04 +00:00 |
|
|
|
1291bdb85e
|
[EPD][Model Loader] Skip language-model checkpoint shards for --mm-encoder-only (#58086)
Signed-off-by: grYe99 <guorongye99@gmail.com>
Co-authored-by: grYe99 <guorongye99@gmail.com>
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
|
2026-09-24 00:41:15 -07:00 |
|
|
siyuandIsotr0py
|
c024cfdb02
|
[Fast Start] Support data parallelism in the weight cache daemon (#57386)
Signed-off-by: liusy58 <mg21330037@smail.nju.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-22 18:19:40 +00:00 |
|
|
siyuandIsotr0py
|
c723a831a8
|
[Fast Start] Cache the MTP draft model in a separate daemon group (#57312)
Signed-off-by: liusy58 <mg21330037@smail.nju.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-22 03:13:38 +00:00 |
|
|
Misha GoinandErinYin
|
e5fce7b56b
|
[Core][Kernel] Share persistent workspaces for Marlin and Humming (#57421)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: ErinYin <liang.yin@daocloud.io>
|
2026-09-20 17:28:33 +08:00 |
|
|
|
b2f2bd71ba
|
[CI][Bugfix] Add tp_shard_with_padding to padded MoE reload test mock (#57402)
Signed-off-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
Co-authored-by: kimi-no-na-wa <kimi-no-na-wa@users.noreply.github.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
|
2026-09-17 13:02:24 -04:00 |
|
|
|
78fdf4efb8
|
[Bugfix][MoE] Convert FlashInfer BF16 weights in place (#54699)
Signed-off-by: Yuchen Wang <93700456+yuchenwang3@users.noreply.github.com>
Signed-off-by: Dakai An <dakaian108@gmail.com>
Co-authored-by: Dakai An <dakaian108@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
|
2026-09-17 22:00:04 +08:00 |
|
|
Harry MellorandClaude Opus 5
|
651a88c09a
|
[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 10:57:24 -07:00 |
|
|
Harry MellorandClaude Opus 5
|
8c1557a79c
|
Add pydocstyle to the ruff rules (#52136)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Harry Mellor <hej.mellor@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 16:44:29 +00:00 |
|
|
aoshen02
|
eb61707851
|
[Bugfix] Fix stale HPC QK-norm weights after weight refit (#56706)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
|
2026-09-14 21:34:41 -07:00 |
|
|
Isotr0py
|
dbf49dad11
|
[Fast Start] Use GPU uuid as socket folder identifier (#56669)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-14 06:28:13 +00:00 |
|
|
siyuandIsotr0py
|
73fb19151f
|
[Fast Start] Support fp4 (#55465)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-10 13:22:17 +00:00 |
|
|
Qiming Zhang
|
49632fb3ac
|
[CI][XPU] Reject CUDA-IPC weight cache on non-CUDA/ROCm platforms (#56010)
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
|
2026-09-10 14:05:07 +08:00 |
|
|
Roderick Wuandmgoin
|
2c9d68f80b
|
[Quant][Kernel] Remove GPTQ Group/Dynamic Activation Ordering (#54809)
Signed-off-by: Roderick-Wu <roderickwu2003@gmail.com>
Signed-off-by: Roderick Wu <roderickwu2003@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-09-08 12:45:12 -07:00 |
|
|
|
a69e75b9b6
|
Fast Start (#54921)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: liusy58 <liusy58@smail.nju.edu.cn>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-04 06:32:06 -07:00 |
|
|
Stellar鱼
|
5182f2705b
|
[CI/Build] Use file rendezvous for UniProc loader fixtures (#52367)
Signed-off-by: yu-xin-c <2182712990@qq.com>
|
2026-08-29 11:53:04 +08:00 |
|
|
Wyett
|
b26039b09f
|
Add routed expert loading for gpt-oss (#52209)
Signed-off-by: Wyett <wyettzeng@gmail.com>
Signed-off-by: wyett <wyettzeng@gmail.com>
|
2026-08-23 17:59:08 +08:00 |
|
|
Shuolei Wangandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
236f78cc5c
|
[Core][RL] Support sparse checkpoint updates through native weight loaders (#50723)
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-08-22 17:39:58 +00:00 |
|
|
Harry Mellor
|
f0c14b4f77
|
Fix weight tying (#51665)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-08-20 10:31:55 +00:00 |
|
|
aoshen02andCodex
|
f2906b492e
|
[Bugfix] Avoid repeated layerwise reload warning scans (#49505)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Codex <noreply@openai.com>
|
2026-08-12 13:53:50 +08:00 |
|
|
Richard Zou
|
cb30f6f8dd
|
[Testing] Fix test_sharded_state_loader (#51736)
Signed-off-by: Richard Zou <zou3519@gmail.com>
|
2026-08-11 21:16:09 +00:00 |
|
|
aoshen02andRoger Wang
|
99e62b802c
|
[Bugfix][Model Loader] Defer post-load attention weight processing (#49519)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Roger Wang <hey@rogerw.io>
|
2026-08-10 19:16:57 -07:00 |
|
|
aoshen02andaoshen02
|
7153fd70f6
|
[Bugfix][MoE] Filter packed expert weights during EP loading (#49558)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
|
2026-08-04 16:32:03 +00:00 |
|
|
Ryan ClarkandClaude Fable 5
|
68fb303a41
|
[Bugfix] Preserve Marlin runtime tensor storage across weight reload (#48438)
Signed-off-by: Ryan Clark <ryanclark2k@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-30 14:50:03 -07:00 |
|
|
Andreas KaratzasandOpenAI Codex
|
30e333ca5f
|
[Bugfix] Shut down private Tensorizer engines (#49840)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-30 12:33:22 -07:00 |
|
|
Harry MellorandClaude Opus 5
|
9321aff536
|
[Bugfix] Wait for the linear bias before layerwise online processing (#49805)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-07-25 17:56:32 +00:00 |
|
|
Harry Mellor
|
9a50464698
|
[CI] Stop flaky test from downloading model every time (#49800)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-25 13:29:36 +00:00 |
|
|
Harry MellorandAndreas Karatzas
|
ca0defa343
|
Make bare hugging_face imports forbidden (#49726)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-25 04:18:39 -07:00 |
|
|
aoshen02andaoshen02
|
ba18929079
|
[Bugfix][SpecDecode] Scope MTP completeness checks outside bucketed updates (#49178)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
|
2026-07-21 18:56:39 -07:00 |
|
|
Michael GoinandOpenAI Codex
|
cc25f028b7
|
[Loader] Improve InstantTensor loading (#46868)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-07-17 16:30:02 -04:00 |
|
|
JoanandDakai An
|
0bd6b85a1f
|
[Bugfix] Preserve unloaded non-persistent buffers during layerwise reload (#44371)
Signed-off-by: Joan Velja <joan.velja22@gmail.com>
Co-authored-by: Dakai An <77474977+andakai@users.noreply.github.com>
|
2026-07-14 17:46:29 -07:00 |
|
|
|
85c09e9885
|
fix: correct load_weights track logic and enable weight integrity for… (#41811)
Signed-off-by: Yipeng Hu <i26268@metax-tech.com>
Signed-off-by: HuYiPeng <144002351+MynameFelix@users.noreply.github.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Yipeng Hu <i26268@metax-tech.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
|
2026-07-10 14:08:20 +00:00 |
|
|
Ting SUN
|
91b5647300
|
[Bugfix][Model] Allow Run:ai memory_limit sentinel values (#47337)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-07-05 00:08:34 +00:00 |
|
|
Chaojun Zhang
|
ea9ddf59fc
|
[XPU][CI] Enable shared loader test (#45977)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
|
2026-06-30 11:20:33 +00:00 |
|
|
Ting SUN
|
9d4b87f4f0
|
[Bugfix][Model] Validate DefaultModelLoader / LoadConfig and fail with clear errors (#45196)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-06-17 21:46:33 +00:00 |
|
|
|
9d808e2309
|
[Core] Use fastsafetensors ParallelLoader for weight loading (#40183)
Signed-off-by: Git Bisector <gitbisector@gmail.com>
Signed-off-by: gitbisector <gitbisector@gmail.com>
Signed-off-by: git bisector <gitbisector@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-06-15 22:32:05 -07:00 |
|
|
Ting SUN
|
3d6ce816f0
|
[Bugfix][Model] Validate runai_streamer model_loader_extra_config (#45291)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-06-14 19:23:30 -07:00 |
|
|
Ting SUN
|
c1076839c9
|
[Bugfix][Model] Pass revision by name in Run:ai and bitsandbytes index downloads (#45308)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-06-11 20:21:46 -07:00 |
|
|
|
c9e5bf8135
|
[Bugfix] Fix layerwise reload dropping params after a composed weight loader (#44814)
Signed-off-by: hallerite <git@hallerite.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>
|
2026-06-10 06:42:05 -07:00 |
|
|
JartX
|
7b476c8f14
|
[ROCm][CI] Skip fp8 reload tests on gfx90a (MI250) (#44369)
Signed-off-by: JartX <sagformas@epdcenter.es>
|
2026-06-02 22:27:14 -05:00 |
|
|
Nick Hill
|
cab5c9a2a9
|
[Core] Move max_concurrent_batches to VllmConfig (#44274)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-06-02 08:57:25 -07:00 |
|
|
Benjamin Bartels
|
05eec7120e
|
Fix RunAI streamer tensor buffer reuse during weight loading (#43464)
Signed-off-by: bbartels <benjamin@bartels.dev>
|
2026-05-27 19:16:52 -07:00 |
|
|
|
17b69828a0
|
[Core] Add native ModelExpress load format (#43105)
Signed-off-by: Zheng Luo <zheluo@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
|
2026-05-21 16:05:01 -04:00 |
|