 youkaichao
|
32176fee73
|
[torch.compile] support moe models (#9632)
Signed-off-by: youkaichao <youkaichao@gmail.com>
|
2024-10-27 21:58:04 -07:00 |
|
|
wangshuai09
|
4e2d95e372
|
[Hardware][ROCM] using current_platform.is_rocm (#9642)
Signed-off-by: wangshuai09 <391746016@qq.com>
|
2024-10-28 04:07:00 +00:00 |
|
|
kakao-kevin-usandKevin-Yang
|
6650e6a930
|
[Model] Add classification Task with Qwen2ForSequenceClassification (#9704)
Signed-off-by: Kevin-Yang <ykcha9@gmail.com>
Co-authored-by: Kevin-Yang <ykcha9@gmail.com>
|
2024-10-26 17:53:35 +00:00 |
|
|
Vasiliy Alekseev
|
07e981fdf4
|
[Frontend] Bad words sampling parameter (#9717)
Signed-off-by: Vasily Alexeev <alvasian@yandex.ru>
|
2024-10-26 16:29:38 +00:00 |
|
|
Mengqing Cao
|
5cbdccd151
|
[Hardware][openvino] is_openvino --> current_platform.is_openvino (#9716)
|
2024-10-26 10:59:06 +00:00 |
|
|
|
6567e13724
|
[Bugfix] Fix crash with llama 3.2 vision models and guided decoding (#9631)
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: pavlo-ruban <pavlo.ruban@servicenow.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
|
2024-10-25 15:42:56 -07:00 |
|
|
Michael Goin
|
ca0d92227e
|
[Bugfix] Fix compressed_tensors_moe bad config.strategy (#9677)
|
2024-10-25 12:40:33 -07:00 |
|
|
Will Johnson
|
a6f3721861
|
[Model] add a lora module for granite 3.0 MoE models (#9673)
|
2024-10-24 22:00:17 -07:00 |
|
|
Michael Goin
|
c91ed47c43
|
[Bugfix] Remove xformers requirement for Pixtral (#9597)
Signed-off-by: mgoin <michael@neuralmagic.com>
|
2024-10-24 15:38:05 -07:00 |
|
|
Charlie Fu
|
59449095ab
|
[Performance][Kernel] Fused_moe Performance Improvement (#9384)
Signed-off-by: charlifu <charlifu@amd.com>
|
2024-10-24 15:37:52 -07:00 |
|
|
Alex Brooks
|
722d46edb9
|
[Model] Compute Llava Next Max Tokens / Dummy Data From Gridpoints (#9650)
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
|
2024-10-24 10:42:24 -07:00 |
|
|
Yongzaoandyoukaichao
|
d27cfbf791
|
[torch.compile] Adding torch compile annotations to some models (#9641)
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
|
2024-10-24 09:31:42 -07:00 |
|
|
litianjian
|
f58454968f
|
[Bugfix]Disable the post_norm layer of the vision encoder for LLaVA models (#9653)
|
2024-10-24 07:52:07 -07:00 |
|
|
Yongzaoandyoukaichao
|
ad6f78053e
|
[torch.compile] expanding support and fix allgather compilation (#9637)
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
|
2024-10-24 01:32:15 -07:00 |
|
|
Jee Jee Li
|
295a061fb3
|
[Kernel] add kernel for FATReLU (#9610)
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
|
2024-10-24 16:18:27 +08:00 |
|
|
Yongzaoandyoukaichao
|
8a02cd045a
|
[torch.compile] Adding torch compile annotations to some models (#9639)
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
|
2024-10-24 00:54:57 -07:00 |
|
|
Cyrus Leung
|
836e8ef6ee
|
[Bugfix] Fix PP for ChatGLM and Molmo (#9422)
|
2024-10-24 06:12:05 +00:00 |
|
|
Michael Goin
|
b7df53cd42
|
[Bugfix] Use "vision_model" prefix for MllamaVisionModel (#9628)
Signed-off-by: mgoin <michael@neuralmagic.com>
|
2024-10-24 10:07:44 +08:00 |
|
|
Michael Goin
|
bb01f2915e
|
[Bugfix][Model] Fix Mllama SDPA illegal memory access for batched multi-image (#9626)
Signed-off-by: mgoin <michael@neuralmagic.com>
|
2024-10-24 10:03:44 +08:00 |
|
|
Yunfei ChuandDarkLight1337
|
fc6c274626
|
[Model] Add Qwen2-Audio model support (#9248)
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2024-10-23 17:54:22 +00:00 |
|
|
Yongzao
|
9013e24f7b
|
[torch.compile] Adding torch compile annotations to some models (#9614)
|
2024-10-23 10:07:48 -07:00 |
|
|
youkaichao
|
dbdd3b5e5a
|
[misc] comment to avoid future confusion about baichuan (#9620)
Signed-off-by: youkaichao <youkaichao@gmail.com>
|
2024-10-23 09:14:44 -07:00 |
|
|
Cyrus LeungandIsotr0py
|
e7116c017c
|
[Bugfix] Fix _init_vision_model in NVLM_D model (#9611)
Co-authored-by: Isotr0py <2037008807@qq.com>
|
2024-10-23 14:09:04 +00:00 |
|
|
Alex Brooks
|
31a08f5bd2
|
[Model] Add min_pixels / max_pixels to Qwen2VL as mm_processor_kwargs (#9612)
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
|
2024-10-23 14:05:18 +00:00 |
|
|
Cyrus LeungandIsotr0py
|
c18e1a3418
|
[VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217)
Co-authored-by: Isotr0py <2037008807@qq.com>
|
2024-10-23 11:27:37 +00:00 |
|
|
Isotr0py
|
3ff57ebfca
|
[Model] Initialize Florence-2 language backbone support (#9555)
|
2024-10-23 10:42:47 +00:00 |
|
|
Mengqing Cao
|
2394962d70
|
[Hardware][XPU] using current_platform.is_xpu (#9605)
|
2024-10-23 08:28:21 +00:00 |
|
|
Cyrus Leung
|
831540cf04
|
[Model] Support E5-V (#9576)
|
2024-10-23 11:35:29 +08:00 |
|
|
youkaichao
|
17c79f3c36
|
[torch.compile] auto infer dynamic_arg_dims from type annotation (#9589)
|
2024-10-22 13:43:37 -07:00 |
|
|
gopalsarda
|
08075c3448
|
[Bugfix] Eagle: change config name for fc bias (#9580)
|
2024-10-22 16:14:22 +00:00 |
|
|
Isotr0py
|
bb392ea2d2
|
[Model][VLM] Initialize support for Mono-InternVL model (#9528)
|
2024-10-22 16:01:46 +00:00 |
|
|
Woosuk Kwon
|
6c5af09b39
|
[V1] Implement vLLM V1 [1/N] (#9289)
|
2024-10-22 01:24:07 -07:00 |
|
|
wangshuai09
|
3ddbe25502
|
[Hardware][CPU] using current_platform.is_cpu (#9536)
|
2024-10-22 00:50:43 -07:00 |
|
|
chenqianfzh
|
0d02747f2e
|
support TP in qwen2 bnb (#9574)
|
2024-10-22 07:13:23 +00:00 |
|
|
Falko1andIsotr0py
|
74692421f7
|
[Bugfix]: phi.py get rope_theta from config file (#9503)
Co-authored-by: Isotr0py <2037008807@qq.com>
|
2024-10-22 02:53:36 +00:00 |
|
|
Michael Goin
|
5241aa1494
|
[Model][Bugfix] Fix batching with multi-image in PixtralHF (#9518)
|
2024-10-21 14:20:07 -04:00 |
|
|
Dhia Eddine Rhaiem
|
f6b97293aa
|
[Model] FalconMamba Support (#9325)
|
2024-10-21 12:50:16 -04:00 |
|
|
Michael Goin
|
962d2c6349
|
[Model][Pixtral] Use memory_efficient_attention for PixtralHFVision (#9520)
|
2024-10-20 05:29:14 +00:00 |
|
|
Michael Goin
|
8e3e7f2713
|
[Model][Pixtral] Optimizations for input_processor_for_pixtral_hf (#9514)
|
2024-10-19 10:44:29 -04:00 |
|
|
Michael Goin
|
3921a2f29e
|
[Model] Support Pixtral models in the HF Transformers format (#9036)
|
2024-10-18 13:29:56 -06:00 |
|
|
Haoyu Wang
|
154a8ae880
|
[Qwen2.5] Support bnb quant for Qwen2.5 (#9467)
|
2024-10-18 04:40:14 +00:00 |
|
|
Dipika Sikka
|
48138a8415
|
[BugFix] Stop silent failures on compressed-tensors parsing (#9381)
|
2024-10-17 18:54:00 -07:00 |
|
|
|
343f8e0905
|
Support BERTModel (first encoder-only embedding model) (#9056)
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Andrew Feldman <afeldman@neuralmagic.com>
Co-authored-by: afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: laishzh <laishengzhang@gmail.com>
Co-authored-by: Max de Bayser <maxdebayser@gmail.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2024-10-17 23:21:01 +00:00 |
|
|
Shashwat Srijan
|
bb76538bbd
|
[Hardwware][Neuron] Simplify model load for transformers-neuronx library (#9380)
|
2024-10-17 15:39:39 -07:00 |
|
|
bnellnm
|
eca2c5f7c0
|
[Bugfix] Fix support for dimension like integers and ScalarType (#9299)
|
2024-10-17 19:08:34 +00:00 |
|
|
Luka Govedič
|
0f41fbe5a3
|
[torch.compile] Fine-grained CustomOp enabling mechanism (#9300)
|
2024-10-17 18:36:37 +00:00 |
|
|
Woosuk Kwon
|
8e1cddcd44
|
[TPU] Call torch._sync(param) during weight loading (#9437)
|
2024-10-17 09:00:11 -07:00 |
|
|
Cyrus Leung
|
390be74649
|
[Misc] Print stack trace using logger.exception (#9461)
|
2024-10-17 13:55:48 +00:00 |
|
|
Lucas Wilkinson
|
e312e52b44
|
[Kernel] Add Exllama as a backend for compressed-tensors (#9395)
|
2024-10-17 09:48:26 -04:00 |
|
|
Russell Bryant
|
776dbd74f1
|
[CI/Build] mypy: Resolve some errors from checking vllm/engine (#9267)
Signed-off-by: Russell Bryant <rbryant@redhat.com>
|
2024-10-16 22:55:59 +00:00 |
|