 zifeitongandWentao Ye
|
52181baaea
|
Update DeepGEMM version pin in Dockerfile to match #32479 (#33935)
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-02-07 05:30:22 -08:00 |
|
zifeitong
|
48b8456ff9
|
[Bugfix] Revert Qwen2-VL part of change in #28271 (#30542)
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
|
2025-12-14 05:20:08 -08:00 |
|
zifeitong
|
a71e4765cc
|
[Bugfix] Fix Qwen2.5-VL quantized model weights loading (#23512)
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
|
2025-08-25 10:40:22 +08:00 |
|
 zifeitongandmgoin
|
6534d2fc97
|
Fix torch version check for SM100 mxfp4 (#22535)
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2025-08-12 12:54:42 -07:00 |
|
zifeitong
|
d3231cb436
|
[Bugfix] Handle content type with optional parameters (#13383)
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
|
2025-02-18 11:29:13 +00:00 |
|
 zifeitongandCyrus Leung
|
d01f66b039
|
[Bugfix] Fix multi-round chat error when mistral tokenizer is used (#12859)
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2025-02-08 07:04:34 +00:00 |
|
zifeitong
|
47db6ec831
|
[Frontend] Add per-request number of cached token stats (#10174)
|
2024-11-12 16:42:28 +00:00 |
|
zifeitong
|
9d59b75593
|
[Bugfix] Remove CustomChatCompletionContentPartParam multimodal input type (#10054)
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
|
2024-11-06 05:13:09 +00:00 |
|
zifeitong
|
43300bd98a
|
[Bugfix] Properly propagate trust_remote_code settings (#10047)
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
|
2024-11-05 16:34:40 -08:00 |
|
zifeitong
|
e3dd0692fa
|
[BugFix] Propagate 'trust_remote_code' setting in internvl and minicpmv (#8250)
|
2024-09-25 05:53:43 +00:00 |
|
zifeitong
|
5340a2dccf
|
[Model] Add multi-image input support for LLaVA-Next offline inference (#7230)
|
2024-08-28 07:09:02 +08:00 |
|
zifeitong
|
80162c44b1
|
[Bugfix] Fix Phi-3v crash when input images are of certain sizes (#7840)
|
2024-08-24 18:16:24 -07:00 |
|
zifeitong
|
df1a21131d
|
[Model] Fix Phi-3.5-vision-instruct 'num_crops' issue (#7710)
|
2024-08-22 09:36:24 +08:00 |
|
 zifeitongandCyrus Leung
|
b47008b4d2
|
[BugFix] BatchResponseData body should be optional (#6345)
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2024-07-15 04:06:09 +00:00 |
|
zifeitong
|
ff9ddbceee
|
[Misc] Remove #4789 workaround left in vllm/entrypoints/openai/run_batch.py (#5756)
|
2024-06-22 03:33:12 +00:00 |
|
zifeitong
|
78687504f7
|
[Bugfix] AsyncLLMEngine hangs with asyncio.run (#5654)
|
2024-06-19 13:57:12 -07:00 |
|
zifeitong
|
26e1188e51
|
[Fix] Use utf-8 encoding in entrypoints/openai/run_batch.py (#5606)
|
2024-06-17 23:16:10 +00:00 |
|
zifeitong
|
a5675d348b
|
[Bugfix] Properly set distributed_executor_backend in ParallelConfig (#4816)
|
2024-05-15 07:22:09 -07:00 |
|
zifeitong
|
a395a638c2
|
[Misc] Use public API in benchmark_throughput (#4300)
|
2024-04-24 21:10:24 +00:00 |
|