 Michael Goin
|
f0b2da72a8
|
Expand MLA to support most types of quantization (#13181)
|
2025-02-13 22:19:22 -08:00 |
|
|
Tyler Michael Smith
|
c1e37bf71b
|
[Kernel][Bugfix] Refactor and Fix CUTLASS 2:4 Sparse Kernels (#13198)
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
|
2025-02-14 00:01:14 +00:00 |
|
|
Michael Goin
|
2344192a55
|
Optimize moe_align_block_size for deepseek_v3 (#12850)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2025-02-13 18:43:37 -05:00 |
|
|
Nicolò Lucchesi
|
d84cef76eb
|
[Frontend] Add /v1/audio/transcriptions OpenAI API endpoint (#12909)
|
2025-02-13 07:23:45 -08:00 |
|
|
Cyrus Leung
|
1bc3b5e71b
|
[VLM] Separate text-only and vision variants of the same model architecture (#13157)
|
2025-02-13 06:19:15 -08:00 |
|
|
燃
|
02ed8a1fbe
|
[Misc] Qwen2.5-VL Optimization (#13155)
|
2025-02-13 06:17:57 -08:00 |
|
|
Cyrus Leung
|
c9d3ecf016
|
[VLM] Merged multi-modal processor for Molmo (#12966)
|
2025-02-13 04:34:00 -08:00 |
|
|
Isotr0py
|
fa253f1a70
|
[VLM] Remove input processor from clip and siglip (#13165)
|
2025-02-13 00:31:37 -08:00 |
|
|
Daniel Han
|
cb944d5818
|
Allow Unsloth Dynamic 4bit BnB quants to work (#12974)
|
2025-02-12 23:13:08 -08:00 |
|
|
Isotr0py
|
bc55d13070
|
[VLM] Implement merged multimodal processor for Mllama (#11427)
|
2025-02-12 20:26:21 -08:00 |
|
|
Michael Goin
|
09972e716c
|
[Bugfix] Allow fallback to AWQ from AWQMarlin at per-layer granularity (#13119)
|
2025-02-12 09:19:53 -08:00 |
|
|
Qubitium-ModelCloud
|
36a08630e8
|
[CORE] [QUANT] Support for GPTQModel's dynamic quantization per module override/control (#7086)
|
2025-02-12 09:19:43 -08:00 |
|
|
Cyrus Leung
|
985b4a2b19
|
[Bugfix] Fix num video tokens calculation for Qwen2-VL (#13148)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2025-02-12 11:55:23 +00:00 |
|
|
Shiyan Deng
|
f1042e86f0
|
[Misc] AMD Build Improvements (#12923)
|
2025-02-12 02:36:10 -08:00 |
|
|
Christian Pinto
|
974dfd4971
|
[Model] IBM/NASA Prithvi Geospatial model (#12830)
|
2025-02-11 20:34:30 -08:00 |
|
|
Yuan Tang
|
14ecab5be2
|
[Bugfix] Guided decoding falls back to outlines when fails to import xgrammar (#12976)
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
|
2025-02-11 18:17:44 +00:00 |
|
|
Szymon Ożóg
|
2b25b7d2e1
|
Fix initializing GGUF weights for ColumnParallelLinear when using tensor parallel > 1 (#13023)
|
2025-02-11 08:38:48 -08:00 |
|
|
Harry Mellor
|
ad9776353e
|
Set torch_dtype in TransformersModel (#13088)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2025-02-11 23:51:19 +08:00 |
|
|
Farzad Abdolhosseini
|
08b2d845d6
|
[Model] Ultravox Model: Support v0.5 Release (#12912)
Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
|
2025-02-10 22:02:48 +00:00 |
|
|
Cyrus Leung
|
51f0b5f7f6
|
[Bugfix] Clean up and fix multi-modal processors (#13012)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2025-02-10 10:45:21 +00:00 |
|
|
youkaichao
|
b2496bb07f
|
[core] fix sleep mode and pytorch checkpoint compatibility (#13001)
Signed-off-by: youkaichao <youkaichao@gmail.com>
|
2025-02-10 13:03:43 +08:00 |
|
|
Patrick von Platenandmgoin
|
d366ccc4e3
|
[RFC] [Mistral] FP8 format (#10130)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2025-02-08 14:12:53 -07:00 |
|
|
Jee Jee Li
|
86222a3dab
|
[VLM] Merged multi-modal processor for GLM4V (#12449)
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
|
2025-02-08 20:32:16 +00:00 |
|
|
Isotr0py
|
4c8dd12ef3
|
[Misc] Add qwen2.5-vl BNB support (#12944)
|
2025-02-08 04:24:47 -08:00 |
|
|
Jun Duan
|
011e612d92
|
[Misc] Log time consumption on weight downloading (#12926)
|
2025-02-08 09:16:42 +00:00 |
|
|
Sanju C Sudhakaran
|
2880e21e3d
|
[Hardware][Intel-Gaudi] Enable long-contexts + LoRA support for Intel Gaudi (#12812)
Signed-off-by: Sanju C Sudhakaran <scsudhakaran@habana.ai>
|
2025-02-08 17:15:30 +08:00 |
|
|
Jee Jee Li
|
306923da82
|
[Bugfix] Fix Qwen2_5_VLForConditionalGeneration packed_modules_mapping (#12905)
|
2025-02-07 21:02:53 -08:00 |
|
|
TJian
|
eaa92d4437
|
[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation Per-Channel-Weight FP8 Quantization Inferencing (#12501)
|
2025-02-07 08:13:43 -08:00 |
|
|
Amit Garg
|
538fab93cd
|
PR #12718 (#12718)
|
2025-02-07 06:22:37 -08:00 |
|
|
Szymon Ożóg
|
aa375dca9f
|
[Bugfix] Missing quant_config in deepseek embedding layer (#12836)
|
2025-02-06 21:35:09 -08:00 |
|
|
Lu Fang
|
741429a4cd
|
[MISC] Check space in the file names in the pre commit checks (#12804)
Signed-off-by: Lu Fang <lufang@fb.com>
|
2025-02-06 15:36:21 -08:00 |
|
|
Yu Chin Fabian LimandTyler Michael Smith
|
aff404571b
|
Add Bamba Model (#10909)
Signed-off-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
|
2025-02-06 15:22:42 -08:00 |
|
|
Varun Sundar RabindranathandVarun Sundar Rabindranath
|
467a96a541
|
[V1] LoRA Support (#10957)
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
|
2025-02-06 09:32:51 -08:00 |
|
|
Isotr0py
|
85ac82d228
|
[Kernel] Make rotary_embedding ops more flexible with input shape (#12777)
|
2025-02-06 08:46:13 -08:00 |
|
|
Dipika Sikka
|
7ca9934fe7
|
[Misc] Update w2 scale loading for GPTQMarlinMoE (#12757)
|
2025-02-06 01:02:14 -08:00 |
|
|
Michael Goin
|
449d1bce02
|
[Misc] Remove duplicated DeepSeek V2/V3 model definition (#12793)
|
2025-02-05 23:16:20 -08:00 |
|
|
Harry Mellor
|
1a6fcad4c9
|
Improve TransformersModel UX (#12785)
|
2025-02-05 22:24:57 -08:00 |
|
|
Sumit Vij
|
d88506dda4
|
[Model] LoRA Support for Ultravox model (#11253)
|
2025-02-05 19:54:13 -08:00 |
|
|
Lu Fang
|
9cdea30b4f
|
[Misc][Easy] Remove the space from the file name
|
2025-02-05 19:23:35 -08:00 |
|
|
Lucas Wilkinson
|
76abd0c881
|
[Bugfix] Better FP8 supported defaults
|
2025-02-05 19:22:19 -08:00 |
|
|
Cyrus Leung
|
75404d041b
|
[VLM] Update compatibility with transformers 4.49
|
2025-02-05 19:09:45 -08:00 |
|
|
Roger Wang
|
bf3b79efb8
|
[VLM] Qwen2.5-VL
|
2025-02-05 13:31:38 -08:00 |
|
|
Cyrus Leung
|
a4ce74c14a
|
[VLM] Use shared field to pass token ids to model
|
2025-02-05 13:30:46 -08:00 |
|
|
Rahul Tuli
|
3b2005e1db
|
Add: Support for Sparse24Bitmask Compressed Models
|
2025-02-05 13:30:43 -08:00 |
|
|
Harry Mellor
|
fcf2e3d7fc
|
[Bugfix] Fix OpenVINO model runner (#12750)
|
2025-02-04 22:42:46 -08:00 |
|
|
Kyle Sayersandmgoin
|
7ff7a638b6
|
[Model][Quant] Fix GLM, Fix fused module mappings for quantization (#12634)
Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
|
2025-02-05 05:32:06 +00:00 |
|
|
Isotr0py
|
98fd089fc9
|
[VLM] Add MLA with pure RoPE support for deepseek-vl2 models (#12729)
|
2025-02-04 20:44:26 -08:00 |
|
|
Harry Mellor
|
249824c3bf
|
Refactor Linear handling in TransformersModel (#12727)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2025-02-05 04:31:12 +00:00 |
|
|
Aviv Keshet
|
b3a0d01e45
|
[Core] add and implement VLLM_LOGITS_PROCESSOR_THREADS (#12368)
Signed-off-by: Aviv Keshet <akeshet@scaledcognition.com>
|
2025-02-04 18:46:26 -08:00 |
|
|
Michael GreenbaumandMichael Greenbaum
|
6469038b14
|
[Bugfix] Fix loading of fine-tuned models based on Phi-3-Small (#12689)
Signed-off-by: Michael Greenbaum <mgreenbaum@microsoft.com>
Co-authored-by: Michael Greenbaum <mgreenbaum@microsoft.com>
|
2025-02-04 20:58:48 +08:00 |
|