Kebe
|
c351fd3c64
|
[Core] Fix ValueError on KV load failure with a hybrid KV cache (#50388)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2026-09-13 21:03:05 +08:00 |
|
Kebe
|
19cf334207
|
[Feature] Support manually enabling the cumem allocator (#33648)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2026-05-20 08:58:30 -04:00 |
|
Kebe
|
5ee5c86eeb
|
[Bugfix][DeepSeek-V3.2] fix fp8 kvcache type cast (#33884)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2026-02-10 19:31:36 -08:00 |
|
 
|
528e9b1490
|
[Feature][Core] Support Fabric detection to adapt the MNNVL protocol for the GB series (#33540)
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Thomas Vegas <tvegas@nvidia.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
|
2026-02-02 22:55:46 +08:00 |
|
Kebe
|
1bf1a34b19
|
[bench] add start_times field to vllm bench serve json result (#32667)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2026-01-22 07:10:14 +00:00 |
|
 KebeandLucas Wilkinson
|
5de6dd0662
|
[Bugfix] [DeepSeek-V3.2] fix sparse_attn_indexer padding (#32175)
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-01-16 03:21:55 +00:00 |
|
 KebeandMichael Goin
|
faed7bf07e
|
[Bugfix] [CPU] bump torch to 2.9.0 for Darwin to fix segmentation fault (#27791)
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
|
2025-11-13 12:48:08 -08:00 |
|
 ![gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>](/assets/img/avatar_default.png)
|
33a0ea5f32
|
[Docs] add Shanghai Meetup - 2025/10 (#27545)
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: esmeetu <jasonailu87@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: esmeetu <jasonailu87@gmail.com>
|
2025-10-31 00:33:13 +08:00 |
|
 KebeandRui Qiao
|
51dd14ac2b
|
[Bugfix][DP] Fix creating too many DP Placement Groups (#26880)
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>
|
2025-10-23 20:16:51 +00:00 |
|
Kebe
|
684b6870e1
|
[Bugfix][Frontend] Fix --enable-log-outputs does not match the documentation (#24626)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-09-12 08:01:24 -07:00 |
|
Kebe
|
8f423e5f43
|
[Feature][Response API] Add streaming support for non-harmony (#23741)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-09-04 17:49:06 +08:00 |
|
Kebe
|
a43a3f1770
|
[Bugfix][DP] DP distribution does not require ray[default] (#23822)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-09-03 13:21:36 -07:00 |
|
Kebe
|
5368f76855
|
[Feature][Responses API] Support logprobs(non-stream) (#23319)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-08-21 23:09:16 +00:00 |
|
Kebe
|
30ef30ed5a
|
[CI] rollback lint-and-deploy pipeline using amd machine (#21912)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-07-30 00:37:59 -07:00 |
|
Kebe
|
396ee94180
|
[CI] Unifying Dockerfiles for ARM and X86 Builds (#21343)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-07-25 07:33:56 -07:00 |
|
Kebe
|
7311f74468
|
[Bugfix] GGUF: fix AttributeError: 'PosixPath' object has no attribute 'startswith' (#21579)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-07-25 03:42:23 -07:00 |
|
Kebe
|
bc8a8ce5ec
|
[Misc] Remove deprecated args in v0.10 (#21349)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-07-22 05:26:39 -07:00 |
|
Kebe
|
b1c1fe35a5
|
[Misc] remove redundant char (#20287)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-07-01 15:33:22 +08:00 |
|
Kebe
|
ef3f98b59f
|
[Bugfix] fix v1 cpu worker fails on macOS (#19121)
|
2025-06-04 20:17:38 +00:00 |
|
Kebe
|
e0f0ff87b8
|
[Build] fix cpu build missing libtbbmalloc.so (#18744)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-05-27 01:03:56 -07:00 |
|
Kebe
|
371376f996
|
[Build] fix Dockerfile shell (#18402)
|
2025-05-21 07:32:06 -07:00 |
|
Kebe
|
5d7f545204
|
[Frontend] deprecate --device arg (#18399)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-05-21 01:21:17 -07:00 |
|
Kebe
|
e11880deea
|
[Bugfix] Remove triton do_bench fast_flush arg (#16256)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-04-08 13:51:06 +00:00 |
|
Kebe
|
b4ac449a83
|
[Misc] Merge the logs of pp layers partitions (#16225)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-04-08 00:18:15 -07:00 |
|
Kebe
|
432cf22a6a
|
[Bugfix] Fix regex compile display format (#15368)
Signed-off-by: Kebe <mail@kebe7jun.com>
|
2025-03-28 08:58:44 -07:00 |
|
 Kebeandyoukaichao
|
4e0f6076be
|
[Bugfix] Fix failure to launch in Tensor Parallel TP mode on macOS. (#14948)
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
|
2025-03-28 10:13:41 +08:00 |
|