 Nick Hill
|
6c18a54648
|
[Perf] Avoid h2d copies from non-pinned CPU tensors (#54299)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-08-29 12:06:30 +08:00 |
|
|
Taneem Ibrahim
|
79bb395eea
|
[Pooling] Improve BGE-M3 sync pooling throughput by up to 3.13% (#53464)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-24 08:33:32 -04:00 |
|
|
Taneem Ibrahim
|
9464529612
|
[ModelRunner v2] Enable decoder token-wise pooling (#50931)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-08-06 22:21:52 +00:00 |
|
|
Taneem Ibrahim
|
5633405964
|
Added extra_repr() to pooler classes to improve debuggability (#44805)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-06-08 03:19:31 +00:00 |
|
|
Nick Hill
|
416f9cdede
|
[Perf][2/n] Eliminate GPU<->CPU syncs in pooling code (#41433)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-05-05 02:43:25 +00:00 |
|
|
Wentao Ye
|
39a7f4f4e2
|
[Perf] Optimize AllPool.forward by slicing first, 51% faster in the method level benchmark (#41163)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-04-29 08:11:04 -07:00 |
|
|
anthonsu
|
76c9cccc36
|
[Core] Fix redundant None append in StepPool.forward for chunked prefill (#41049)
Signed-off-by: Anthony Su <xsuanthony@gmail.com>
|
2026-04-27 23:42:47 -07:00 |
|
|
wang.yuqi
|
cb5f7501cb
|
[New Model]: jinaai/jina-reranker-v3 (#38800)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-04-10 15:20:40 +00:00 |
|
|
Augusto Yao
|
b386bb3d7c
|
fix bugs when token_classify & classify run concurrently (#36614)
Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
|
2026-03-10 20:16:34 -07:00 |
|
|
Cyrus Leung
|
583a90e005
|
[Refactor] Separate sequence and token pooling types (#32026)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-01-10 04:53:24 +00:00 |
|
|
Cyrus Leung
|
c8ed39b9dd
|
[Model] Reorganize pooling layers (#31973)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-01-09 11:02:14 +00:00 |
|