MOVZX and Hinata
2b544b7ba0
[Mini-VLLM] Cut dead subsystems across serving, connectors, parsers
...
- Remove P/D transfer connectors: nixl, nixl_chat, mooncake x2, hf3fs,
moriio, hisparse, example and hidden-states connectors
- Reduce weight_transfer to the base API used by model loading
- Remove kv_offload tiering, simple_kv_offload, ec cpu/example,
snapshot command, engine snapshot server
- Remove transformers model fallback, dsv4 tokenizers, dead platforms
cpu/tpu/xpu, flashmla third_party, dsa, megamoe/flydsl, dead attn
ops, dead layers (short_conv, fused_embed_norm, indexer_topk,
relu2 gemma_ar, lightning_attn, minimax_rms_norm), gemm_rs_ar
- Keep MoE LoRA op (imported eagerly by punica_gpu); drop fp8 variant
- Rebuild parser hubs around Qwen3 adapters only (36 dead adapters)
- Remove dead tests with the code they covered
Co-authored-by: Hinata <hinata@idihore.id >
Signed-off-by: MOVZX <movzx@yahoo.com >
2026-10-19 02:19:03 +07:00
alp and mottopanikeiku
2268d83bd9
[Bugfix][Multimodal] Honor RGB PNG transparency when loading images ( #61986 )
...
Signed-off-by: mottopanikeiku <176798723+mottopanikeiku@users.noreply.github.com >
Co-authored-by: mottopanikeiku <176798723+mottopanikeiku@users.noreply.github.com >
2026-10-16 23:09:12 +00:00
a9fe30e9f6
[Bugfix][Multimodal] Recover PyNvVideoCodec decoder slots after failures ( #59597 )
...
Signed-off-by: Daniel Afrimi <dafrimi@nvidia.com >
Signed-off-by: danielafrimi <45691845+danielafrimi@users.noreply.github.com >
Signed-off-by: Daniel Afrimi <dafrimi@oci-hsg-cs-001-login-02.cm.cluster >
Co-authored-by: OpenAI Codex <noreply@openai.com >
Co-authored-by: Daniel Afrimi <dafrimi@oci-hsg-cs-001-login-02.cm.cluster >
Co-authored-by: tomeras91 <57313761+tomeras91@users.noreply.github.com >
2026-10-15 09:17:19 +03:00
Juan Pérez de Algaba and OpenAI Codex
7173c64e2e
[Security] Bound decoded and downloaded media per request ( #61226 )
...
Signed-off-by: juanpas97 <juan.perezalgaba@gmail.com >
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-10-13 10:17:14 +00:00
Harry Mellor and Claude Opus 5.5
21d9758459
Remove Python 3.10 support now that it is EOL ( #60402 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-08 02:30:52 -07:00
Juan Pérez de Algaba
710ac56e69
[Security] Restrict Pillow image formats on untrusted media paths ( #60022 )
...
Signed-off-by: Juan Pérez de Algaba <jperezde@redhat.com >
2026-10-05 10:40:15 +00:00
Harry Mellor and Claude Opus 5.5
fc2c801ad9
Disable mypy arg-type and assignment checks in tests ( #59428 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-30 15:18:50 +00:00
5225f1bacb
[MyPy][3/N] Fix MyPy errors in test groups (part 3) ( #55939 )
...
Signed-off-by: Taimys <ffy2281693949@gmail.com >
Signed-off-by: Luyi Xiao <81631911+luyixiao95@users.noreply.github.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Codex <noreply@openai.com >
Co-authored-by: Luyi Xiao <81631911+luyixiao95@users.noreply.github.com >
Co-authored-by: Taimys <ffy2281693949@gmail.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-30 11:06:07 +00:00
Isotr0py
31876d8ea1
[Bugfix] Fix TorchCodec audio IO correctness ( #58364 )
...
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
2026-09-29 11:34:48 -05:00
Kevin H. Luu and Kimi
f2b6152ec2
[CI] Add flaky rerun markers / timeout skips to sibling tests lacking them ( #57359 )
...
Signed-off-by: khluu <khluu000@gmail.com >
Co-authored-by: Kimi <noreply@moonshot.cn >
2026-09-18 03:40:32 -07:00
Harry Mellor and Claude Opus 5
651a88c09a
[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings ( #57212 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-16 10:57:24 -07:00
Harry Mellor and Claude Opus 5
8c1557a79c
Add pydocstyle to the ruff rules ( #52136 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Signed-off-by: Harry Mellor <hej.mellor@gmail.com >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-16 16:44:29 +00:00
Isotr0py
22258a26bc
[Multimodal] Use GPU NVDEC for EPD encoder-only instance video media IO ( #53675 )
...
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
2026-09-11 22:20:11 +08:00
Andreas Karatzas
f7f060d253
[Bugfix][Audio] Restore soundfile-first automatic decoding ( #55642 )
...
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com >
2026-09-07 06:21:02 +00:00
6a039f465e
[feat] add torchcodec as audio loader and implement selective audio backend ( #51826 )
...
Signed-off-by: JaredforReal <w13431838023@gmail.com >
Co-authored-by: saltman155 <saltman155@outlook.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
2026-09-04 16:16:10 +00:00
Isotr0py
4fc943b867
[Multimodal] Deprecate PyAV video decoder backend ( #54231 )
...
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
2026-08-29 15:13:28 +00:00
Moe Huzaifa
299ebd094a
[Bugfix][Multimodal] Reject malformed base64 audio with 400 instead of 500 ( #53744 )
...
Signed-off-by: mhuzaifa3 <mhuzaifa3@outlook.com >
2026-08-25 17:31:42 +00:00
Clinton Thomas and Lucas Bourtoule
2ec6f0d71e
Reject oversized media before fully downloading it ( #51896 )
...
Signed-off-by: Clinton Thomas <1033162+KernelClint@users.noreply.github.com >
Co-authored-by: Lucas Bourtoule <35483370+dhalf@users.noreply.github.com >
2026-08-24 01:15:09 +00:00
Isotr0py
3bb9c18f0c
[Multimodal] Reorganize video decoder backends ( #49155 )
...
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
2026-08-18 15:06:18 +00:00
wang.yuqi
b8165e5e58
[Frontend] Consolidate entrypoint exception handler ( #52261 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-08-14 09:27:24 +00:00
Kevin H. Luu and OpenAI Codex
8eb35c5217
[CI] Mirror external test assets in vLLM S3 ( #52064 )
...
Signed-off-by: khluu <khluu000@gmail.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
2026-08-13 02:08:59 +00:00
dmai-afk
86e2ab50aa
[Bugfix][Frontend] Return 400 for invalid PyNvVideoCodec video input ( #51120 )
...
Signed-off-by: Dat Mai <dmai@nvidia.com >
2026-08-12 10:58:46 +00:00
Juan Pérez de Algaba and Cursor
640a09086d
Fix DoS via sample-rate forgery bypassing audio decode duration guard ( #49948 )
...
Signed-off-by: jperezde <jperezde@redhat.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-08-10 15:49:17 +00:00
Junpu Yu
d3621c1eb3
[Bugfix][Multimodal] Fix PyNvVideoCodec video backend returning NCHW instead of NHWC ( #51076 )
...
Signed-off-by: Junpu Yu <davidyu@nvidia.com >
2026-08-08 04:49:06 +00:00
Juan Pérez de Algaba
d83eb0b36b
fix(security): classify DeepStream as GPU backend and enforce pixel limits ( #50755 )
...
Signed-off-by: jperezde <jperezde@redhat.com >
2026-08-03 08:23:09 +00:00
Zach Zhu
58f9659397
[Frontend][Core] Standardize request error handling with VLLMError hierarchy ( #49665 )
...
Signed-off-by: Zach Zhu <zzqshu@126.com >
2026-07-29 04:20:40 +00:00
Brandon Pelfrey and OpenAI Codex
94682b79f4
[multimodal] Make PyNvVideoCodec decoder concurrency configurable ( #49753 )
...
Signed-off-by: Brandon Pelfrey <bpelfrey@nvidia.com >
Co-authored-by: OpenAI Codex <noreply@openai.com >
2026-07-24 23:31:41 -07:00
Thomas Fahrner and Claude Fable 5
d02df748bf
[Bugfix] Accept RFC 2397 parameters in base64 data URLs ( #48973 )
...
Signed-off-by: Thomas Fahrner <thomas.fahrner@parasail.io >
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-07-24 08:23:08 -07:00
Isotr0py
15cb8e140d
[Multimodal] Allow keeping original image mode for ImageIO ( #49159 )
...
Signed-off-by: Isotr0py <Isotr0py@outlook.com >
2026-07-20 13:42:45 +00:00
Alexis K.
40cc2e8327
[Bugfix] Return HTTP 422 for unprocessable image URLs instead of 500 ( #47165 )
...
Signed-off-by: Alexis Kinsella <alexis.kinsella@gmail.com >
2026-07-06 11:56:23 +00:00
Juan Pérez de Algaba and mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
ba22152096
fix(security): block request-level GPU video backend selection withou… ( #47259 )
...
Signed-off-by: jperezde <jperezde@redhat.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-07-06 02:36:49 -07:00
VectorPeak
68294739d1
[Bugfix] Align OpenCV video metadata timeline ( #47099 )
...
Signed-off-by: VectorPeak <73048950+VectorPeak@users.noreply.github.com >
2026-06-30 20:43:42 +00:00
Juan Pérez de Algaba
364ee36af1
fix(security): prevent image decompression bomb OOM denial of service ( #47010 )
...
Signed-off-by: jperezde <jperezde@redhat.com >
2026-06-30 09:39:22 +00:00
Matti4
1502cf6274
Fix relative allowed local media paths ( #45263 )
2026-06-25 20:45:20 -07:00
Juan Pérez de Algaba
1b1359c332
[Security] Fix DoS via audio decompression bomb in speech-to-text endpoint ( #44970 )
...
Signed-off-by: jperezde <jperezde@redhat.com >
2026-06-10 00:18:53 +08:00
Nick Cao and Claude
153ba7f0f3
[Refactor] Drop direct dependency on librosa ( #39079 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-04-18 06:55:38 +00:00
Juan Pérez de Algaba
58ee614221
(security) Enforce frame limit in VideoMediaIO ( #38636 )
...
Signed-off-by: jperezde <jperezde@redhat.com >
2026-04-01 10:23:45 +00:00
Andreas Karatzas
677424c7ac
[Core][CI] Add opt-in media URL caching via VLLM_MEDIA_CACHE ( #37123 )
...
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
2026-03-30 04:58:53 -07:00
aliialsaeedii
7e76af14fa
[Bugfix][Frontend] Return 400 for corrupt/truncated image inputs instead of 500 ( #38253 )
...
Signed-off-by: aliialsaeedii <ali.al-saeedi@nscale.com >
2026-03-30 10:26:46 +00:00
Isotr0py
c7f98b4d0a
[Frontend] Remove librosa from audio dependency ( #37058 )
...
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2026-03-21 11:36:15 +08:00
918b7890a1
[Bugfix] Fix base64 JPEG video frames returning empty metadata ( #37301 )
...
Signed-off-by: Yufeng He <40085740+universeplayer@users.noreply.github.com >
Signed-off-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: Yufeng He <40085740+universeplayer@users.noreply.github.com >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2026-03-18 13:40:03 +00:00
Isotr0py
a836524d20
[Chore] Replace all base64 usages with faster pybase64 package ( #37290 )
...
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2026-03-17 14:44:19 +00:00
Isotr0py
143e4dccdf
[Misc] Add online audio_in_video test ( #36775 )
...
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2026-03-15 00:14:11 -07:00
Russell Bryant and isotr0py
6f3b2047ab
[Core] Fix SSRF bypass via backslash-@ URL parsing inconsistency ( #34743 )
...
Signed-off-by: Russell Bryant <rbryant@redhat.com >
Co-authored-by: isotr0py <2037008807@qq.com >
2026-02-18 03:53:35 +00:00
Cyrus Leung
116880a5a0
[Bugfix] Make MM batching more robust ( #33817 )
...
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk >
2026-02-05 20:40:58 +00:00
Cyrus Leung
28459785ff
[3/N] Group together media-related code ( #32406 )
...
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk >
2026-01-15 11:52:12 +00:00