 firebook
|
2b981012a6
|
Fix Baichuan2-7B-Chat (#1987)
|
2023-12-08 09:38:36 -08:00 |
|
|
|
6ccc0bfffb
|
Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836)
Co-authored-by: Philipp Moritz <pcmoritz@gmail.com>
Co-authored-by: Amir Balwel <amoooori04@gmail.com>
Co-authored-by: root <kuanfu.liu@akirakan.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: kuanfu <kuanfu.liu@embeddedllm.com>
Co-authored-by: miloice <17350011+kliuae@users.noreply.github.com>
|
2023-12-07 23:16:52 -08:00 |
|
|
Jie Liandlijie8
|
ebede26ebf
|
Make InternLM follow rope_scaling in config.json (#1956)
Co-authored-by: lijie8 <lijie8@sensetime.com>
|
2023-12-07 08:32:08 -08:00 |
|
|
dancingpipiandshujunhua1
|
1d9b737e05
|
Support ChatGLMForConditionalGeneration (#1932)
Co-authored-by: shujunhua1 <shujunhua1@jd.com>
|
2023-12-05 10:52:48 -08:00 |
|
|
Roy
|
60dc62dc9e
|
add custom server params (#1868)
|
2023-12-03 12:59:18 -08:00 |
|
|
Woosuk Kwon
|
0f90effc66
|
Bump up to v0.2.3 (#1903)
|
2023-12-03 12:27:47 -08:00 |
|
|
Woosuk Kwon
|
464dd985e3
|
Fix num_gpus when TP > 1 (#1852)
|
2023-12-03 12:24:30 -08:00 |
|
|
Woosuk Kwon
|
9b294976a2
|
Add PyTorch-native implementation of custom layers (#1898)
|
2023-12-02 21:18:40 -08:00 |
|
|
Simon Mo
|
5313c2cb8b
|
Add Production Metrics in Prometheus format (#1890)
|
2023-12-02 16:37:44 -08:00 |
|
|
Woosuk KwonandAntoni Baum
|
5f09cbdb63
|
Fix broken sampler tests (#1896)
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
|
2023-12-02 16:06:17 -08:00 |
|
|
Jerry
|
f86bd6190a
|
Fix the typo in SamplingParams' docstring (#1886)
|
2023-12-01 02:06:36 -08:00 |
|
|
Woosuk Kwon
|
e5452ddfd6
|
Normalize head weights for Baichuan 2 (#1876)
|
2023-11-30 20:03:58 -08:00 |
|
|
Woosuk Kwon
|
d06980dfa7
|
Fix Baichuan tokenizer error (#1874)
|
2023-11-30 18:35:50 -08:00 |
|
|
Adam Brusselback
|
66785cc05c
|
Support chat template and echo for chat API (#1756)
|
2023-11-30 16:43:13 -08:00 |
|
|
Roy
|
d27f4bae39
|
Fix rope cache key error (#1867)
|
2023-11-30 08:29:28 -08:00 |
|
|
Jee Li
|
63b2206ad0
|
Avoid multiple instantiations of the RoPE class (#1828)
|
2023-11-29 23:06:27 -08:00 |
|
|
Woosuk Kwon
|
27feead2f8
|
Refactor Worker & InputMetadata (#1843)
|
2023-11-29 22:16:37 -08:00 |
|
|
Michael McCullochandMichael McCulloch
|
c782195662
|
Disable Logs Requests should Disable Logging of requests. (#1779)
Co-authored-by: Michael McCulloch <mjm.gitlab@fastmail.com>
|
2023-11-29 21:50:02 -08:00 |
|
|
Woosuk Kwon
|
a9e4574261
|
Refactor Attention (#1840)
|
2023-11-29 15:37:31 -08:00 |
|
|
FlorianJoncourandFlorianJoncour
|
0229c386c5
|
Better integration with Ray Serve (#1821)
Co-authored-by: FlorianJoncour <florian@zetta-sys.com>
|
2023-11-29 13:25:43 -08:00 |
|
|
Woosuk Kwon
|
a7b3e33078
|
[Fix] Fix RoPE in ChatGLM-32K (#1841)
|
2023-11-29 13:01:19 -08:00 |
|
|
Zhuohan Li
|
1cb4ad8de9
|
[FIX] Fix formatting error
|
2023-11-29 00:40:19 +00:00 |
|
|
explainerauthors
|
6ed068a71a
|
Use the type BlockTable (#1791)
|
2023-11-28 16:34:05 -08:00 |
|
|
Zhuohan Li
|
708e6c18b0
|
[FIX] Fix class naming (#1803)
|
2023-11-28 14:08:01 -08:00 |
|
|
Woosuk Kwon
|
b943890484
|
Fix OPT param names (#1819)
|
2023-11-28 11:22:44 -08:00 |
|
|
explainerauthors
|
a1125ad4df
|
Correct comments in parallel_state.py (#1818)
|
2023-11-28 10:19:35 -08:00 |
|
|
ljss
|
a8b150c595
|
Init model on GPU to reduce CPU memory footprint (#1796)
|
2023-11-27 11:18:26 -08:00 |
|
|
Yunmo Chen
|
665cbcec4b
|
Added echo function to OpenAI API server. (#1504)
|
2023-11-26 21:29:17 -08:00 |
|
|
Woosuk Kwon
|
7c600440f7
|
Fix model docstrings (#1764)
|
2023-11-23 23:04:44 -08:00 |
|
|
Yanming W
|
e0c6f556e8
|
[Build] Avoid building too many extensions (#1624)
|
2023-11-23 16:31:19 -08:00 |
|
|
ljss
|
de23687d16
|
Fix repetition penalty aligned with huggingface (#1577)
|
2023-11-22 14:41:44 -08:00 |
|
|
ljss
|
4cea74c73b
|
Set top_p=0 and top_k=-1 in greedy sampling (#1748)
|
2023-11-22 12:51:09 -08:00 |
|
|
Casper
|
a921d8be9d
|
[DOCS] Add engine args documentation (#1741)
|
2023-11-22 12:31:27 -08:00 |
|
|
陈序
|
094f716bf2
|
Add stop_token_ids in SamplingParams.__repr__ (#1745)
|
2023-11-21 20:13:53 -08:00 |
|
|
Zhuohan Li
|
7d761fe3c1
|
[FIX] Fix the case when input_is_parallel=False for ScaledActivation (#1737)
|
2023-11-20 23:56:48 -08:00 |
|
|
Woosuk Kwon
|
cf35d8f3d7
|
[BugFix] Fix TP support for AWQ (#1731)
|
2023-11-20 21:42:45 -08:00 |
|
|
boydfdandran_lin
|
4bb6b67188
|
fix RAM OOM when load large models in tensor parallel mode. (#1395)
Co-authored-by: ran_lin <rlin@thoughtworks.com>
|
2023-11-20 19:02:42 -08:00 |
|
|
ljss
|
819b18e7ba
|
Rewrite torch.repeat_interleave to remove cpu synchronization (#1599)
|
2023-11-20 17:46:32 -08:00 |
|
|
Zhuofan
|
19849db573
|
[Fix] Fix bugs in scheduler (#1727)
|
2023-11-20 16:10:50 -08:00 |
|
|
陈序
|
3d4ceb292c
|
Fix hanging in the scheduler caused by long prompts (#1534)
|
2023-11-20 16:06:49 -08:00 |
|
|
Woosuk Kwon
|
f5a37c6c6c
|
[BugFix] Fix a bug in loading safetensors (#1732)
|
2023-11-20 15:51:18 -08:00 |
|
|
Simon Mo
|
5ffc0d13a2
|
Migrate linter from pylint to ruff (#1665)
|
2023-11-20 11:58:01 -08:00 |
|
|
Woosuk Kwon
|
c5f7740d89
|
Bump up to v0.2.2 (#1689)
|
2023-11-18 21:57:07 -08:00 |
|
|
Woosuk Kwon
|
be66d9b125
|
Fix warning msg on quantization (#1715)
|
2023-11-18 21:49:55 -08:00 |
|
|
ljss
|
e1054247ba
|
[Optimization] Implement fused add rmsnorm (#1667)
|
2023-11-18 18:18:02 -08:00 |
|
|
Woosuk Kwon
|
8d17774f92
|
Add AWQ support for all models (#1714)
|
2023-11-18 17:56:47 -08:00 |
|
|
twaka
|
e946260cf3
|
use get_tensor in safe_open (#1696)
|
2023-11-18 16:45:18 -08:00 |
|
|
liuyhwangyh
|
edb305584b
|
Support download models from www.modelscope.cn (#1588)
|
2023-11-17 20:38:31 -08:00 |
|
|
Woosuk Kwon
|
bb00f66e19
|
Use quantization_config in hf config (#1695)
|
2023-11-17 16:23:49 -08:00 |
|
|
Roy
|
e87557b069
|
Support Min P Sampler (#1642)
|
2023-11-17 16:20:49 -08:00 |
|