 Woosuk Kwon
|
06bfb51963
|
[V1] Add BlockTable class (#11693)
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
|
2025-01-06 14:24:42 +09:00 |
|
|
Woosuk Kwon
|
b55ed6ef8a
|
[V1][Minor] Optimize token_ids_cpu copy (#11692)
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
|
2025-01-02 12:04:58 -07:00 |
|
|
Woosuk Kwon
|
42bb201fd6
|
[V1][Minor] Set pin_memory=False for token_ids_cpu tensor (#11581)
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
|
2024-12-28 13:33:12 +00:00 |
|
|
sroy745andWoosuk Kwon
|
dcb1a944d4
|
[V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681)
Signed-off-by: Sourashis Roy <sroy@roblox.com>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
|
2024-12-26 19:02:58 +09:00 |
|
|
Mark McLoughlin
|
6d917d0eeb
|
Enable mypy checking on V1 code (#11105)
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
|
2024-12-14 09:54:04 -08:00 |
|
|
Woosuk Kwon
|
f092153fbe
|
[V1] Use more persistent buffers to optimize input preparation overheads (#11111)
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
|
2024-12-11 23:14:20 -08:00 |
|
|
Woosuk Kwon
|
6faec54505
|
[V1] Do not store None in self.generators (#11038)
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
|
2024-12-09 15:08:19 -08:00 |
|
|
Varun Sundar RabindranathandVarun Sundar Rabindranath
|
25b79d9fd3
|
[V1] Input Batch Relocation (#10962)
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
|
2024-12-09 09:33:41 -08:00 |
|