Jongseok Park
|
781096e385
|
Expert Parallelism (EP) Support for DeepSeek V2 (#12583)
|
2025-02-24 07:33:20 -08:00 |
|
Mengqing Cao
|
23eca9cf68
|
[model][refactor] remove cuda hard code in models and layers (#13658)
|
2025-02-24 06:10:14 -08:00 |
|
Isotr0py
|
ba5106e519
|
[LMM] Implement merged multimodal processor for whisper (#13278)
|
2025-02-23 01:46:03 -08:00 |
|
Kyle Sayers
|
d5ca2110f1
|
[Quant] BaiChuan SupportsQuant (#13710)
|
2025-02-22 19:21:15 -08:00 |
|
Jee Jee Li
|
105b8ce4c0
|
[Misc] Reduce LoRA-related static variable (#13166)
|
2025-02-22 00:21:30 -08:00 |
|
Shane A
|
9a1f1da5d1
|
[Bugfix][Model] OLMo 2: split qkv correctly for GQA and MQA (#13687)
|
2025-02-21 22:07:45 -08:00 |
|
燃
|
041e294716
|
[Misc] add mm_processor_kwargs to extra_body for Qwen2.5-VL (#13533)
|
2025-02-19 23:04:30 -08:00 |
|
Jee Jee Li
|
512368e34a
|
[Misc] Qwen2.5 VL support LoRA (#13261)
|
2025-02-19 18:37:55 -08:00 |
|
Cyrus Leung
|
377d10bd14
|
[VLM][Bugfix] Pass processor kwargs properly on init (#13516)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2025-02-19 13:13:50 +00:00 |
|
 Lucia FangandLiuXiaoxuanPKU
|
f525c0be8b
|
[Model][Speculative Decoding] DeepSeek MTP spec decode (#12755)
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
|
2025-02-19 17:06:23 +08:00 |
|
Alex Brooks
|
983a40a8bb
|
[Bugfix] Fix Positive Feature Layers in Llava Models (#13514)
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
|
2025-02-19 08:50:07 +00:00 |
|
Kyle Sayers
|
d1b649f1ef
|
[Quant] Aria SupportsQuant (#13416)
|
2025-02-17 21:51:09 -08:00 |
|
Kyle Sayers
|
00294e1bc6
|
[Quant] Arctic SupportsQuant (#13366)
|
2025-02-17 21:35:09 -08:00 |
|
Kyle Sayers
|
88787bce1d
|
[Quant] Molmo SupportsQuant (#13336)
|
2025-02-17 21:34:47 -08:00 |
|
Isotr0py
|
67ef8f666a
|
[Model] Enable quantization support for transformers backend (#12960)
|
2025-02-17 19:52:47 -08:00 |
|
 Tyler Michael SmithandYu Chin Fabian Lim
|
1f69c4a892
|
[Model] Support Mamba2 (Codestral Mamba) (#9292)
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
|
2025-02-17 20:17:50 +08:00 |
|
Cyrus Leung
|
7b623fca0b
|
[VLM] Check required fields before initializing field config in DictEmbeddingItems (#13380)
|
2025-02-17 01:36:07 -08:00 |
|
shangmingc
|
46cdd59577
|
[Feature][Spec Decode] Simplify the use of Eagle Spec Decode (#12304)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
|
2025-02-16 19:32:26 -08:00 |
|
Kyle Sayers
|
12913d17ba
|
[Quant] Add SupportsQuant to phi3 and clip (#13104)
|
2025-02-15 19:28:33 -08:00 |
|
Cyrus Leung
|
367cb8ce8c
|
[Doc] [2/N] Add Fuyu E2E example for multimodal processor (#13331)
|
2025-02-15 07:06:23 -08:00 |
|
Isotr0py
|
7fdaaf48ef
|
[Bugfix] Fix qwen2.5-vl image processor (#13286)
|
2025-02-15 03:00:11 -08:00 |
|
Cyrus Leung
|
4da1f667e9
|
[VLM] Keep track of whether prompt replacements have been applied (#13215)
|
2025-02-14 04:20:46 -08:00 |
|
Nicolò Lucchesi
|
d84cef76eb
|
[Frontend] Add /v1/audio/transcriptions OpenAI API endpoint (#12909)
|
2025-02-13 07:23:45 -08:00 |
|
Cyrus Leung
|
1bc3b5e71b
|
[VLM] Separate text-only and vision variants of the same model architecture (#13157)
|
2025-02-13 06:19:15 -08:00 |
|
燃
|
02ed8a1fbe
|
[Misc] Qwen2.5-VL Optimization (#13155)
|
2025-02-13 06:17:57 -08:00 |
|
Cyrus Leung
|
c9d3ecf016
|
[VLM] Merged multi-modal processor for Molmo (#12966)
|
2025-02-13 04:34:00 -08:00 |
|
Isotr0py
|
fa253f1a70
|
[VLM] Remove input processor from clip and siglip (#13165)
|
2025-02-13 00:31:37 -08:00 |
|
Isotr0py
|
bc55d13070
|
[VLM] Implement merged multimodal processor for Mllama (#11427)
|
2025-02-12 20:26:21 -08:00 |
|
Cyrus Leung
|
985b4a2b19
|
[Bugfix] Fix num video tokens calculation for Qwen2-VL (#13148)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2025-02-12 11:55:23 +00:00 |
|
Shiyan Deng
|
f1042e86f0
|
[Misc] AMD Build Improvements (#12923)
|
2025-02-12 02:36:10 -08:00 |
|
Christian Pinto
|
974dfd4971
|
[Model] IBM/NASA Prithvi Geospatial model (#12830)
|
2025-02-11 20:34:30 -08:00 |
|
Harry Mellor
|
ad9776353e
|
Set torch_dtype in TransformersModel (#13088)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2025-02-11 23:51:19 +08:00 |
|
Farzad Abdolhosseini
|
08b2d845d6
|
[Model] Ultravox Model: Support v0.5 Release (#12912)
Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
|
2025-02-10 22:02:48 +00:00 |
|
Cyrus Leung
|
51f0b5f7f6
|
[Bugfix] Clean up and fix multi-modal processors (#13012)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2025-02-10 10:45:21 +00:00 |
|
 Patrick von Platenandmgoin
|
d366ccc4e3
|
[RFC] [Mistral] FP8 format (#10130)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2025-02-08 14:12:53 -07:00 |
|
Jee Jee Li
|
86222a3dab
|
[VLM] Merged multi-modal processor for GLM4V (#12449)
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
|
2025-02-08 20:32:16 +00:00 |
|
Isotr0py
|
4c8dd12ef3
|
[Misc] Add qwen2.5-vl BNB support (#12944)
|
2025-02-08 04:24:47 -08:00 |
|
Jee Jee Li
|
306923da82
|
[Bugfix] Fix Qwen2_5_VLForConditionalGeneration packed_modules_mapping (#12905)
|
2025-02-07 21:02:53 -08:00 |
|
Amit Garg
|
538fab93cd
|
PR #12718 (#12718)
|
2025-02-07 06:22:37 -08:00 |
|
Szymon Ożóg
|
aa375dca9f
|
[Bugfix] Missing quant_config in deepseek embedding layer (#12836)
|
2025-02-06 21:35:09 -08:00 |
|
 Yu Chin Fabian LimandTyler Michael Smith
|
aff404571b
|
Add Bamba Model (#10909)
Signed-off-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
|
2025-02-06 15:22:42 -08:00 |
|
Isotr0py
|
85ac82d228
|
[Kernel] Make rotary_embedding ops more flexible with input shape (#12777)
|
2025-02-06 08:46:13 -08:00 |
|
Michael Goin
|
449d1bce02
|
[Misc] Remove duplicated DeepSeek V2/V3 model definition (#12793)
|
2025-02-05 23:16:20 -08:00 |
|
Harry Mellor
|
1a6fcad4c9
|
Improve TransformersModel UX (#12785)
|
2025-02-05 22:24:57 -08:00 |
|
Sumit Vij
|
d88506dda4
|
[Model] LoRA Support for Ultravox model (#11253)
|
2025-02-05 19:54:13 -08:00 |
|
Cyrus Leung
|
75404d041b
|
[VLM] Update compatibility with transformers 4.49
|
2025-02-05 19:09:45 -08:00 |
|
Roger Wang
|
bf3b79efb8
|
[VLM] Qwen2.5-VL
|
2025-02-05 13:31:38 -08:00 |
|
Cyrus Leung
|
a4ce74c14a
|
[VLM] Use shared field to pass token ids to model
|
2025-02-05 13:30:46 -08:00 |
|
 Kyle Sayersandmgoin
|
7ff7a638b6
|
[Model][Quant] Fix GLM, Fix fused module mappings for quantization (#12634)
Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
|
2025-02-05 05:32:06 +00:00 |
|
Isotr0py
|
98fd089fc9
|
[VLM] Add MLA with pure RoPE support for deepseek-vl2 models (#12729)
|
2025-02-04 20:44:26 -08:00 |
|