Keyun Tong
|
26bc4bbcd8
|
Avoid overwriting vllm_compile_cache.py (#17418)
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
|
2025-05-01 07:30:57 +00:00 |
|
Keyun Tong
|
8db1b9d0a1
|
Support SSL Key Rotation in HTTP Server (#13495)
|
2025-02-22 05:17:44 -08:00 |
|
Keyun Tong
|
0ffdf8ce0c
|
[HTTP Server] Make model param optional in request (#13568)
|
2025-02-21 21:55:50 -08:00 |
|
Keyun Tong
|
3ee696a63d
|
[RFC][vllm-API] Support tokenizer registry for customized tokenizer in vLLM (#12518)
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
|
2025-02-12 12:25:58 +08:00 |
|
Keyun Tong
|
fa63e710c7
|
[V1][Perf] Reduce scheduling overhead in model runner after cuda sync (#12094)
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
|
2025-01-26 00:42:37 -08:00 |
|
Keyun Tong
|
ad388d25a8
|
Type-fix: make execute_model output type optional (#12020)
|
2025-01-15 09:44:56 +00:00 |
|