Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86

Mono Color

• 19682023b6 [Doc] Fix typo error in CONTRIBUTING.md (#10190) FuryMartin 2024-11-10 15:47:24 +08:00
• 9fa4bdde9d [ci][build] limit cmake version (#10188) youkaichao 2024-11-09 16:27:26 -08:00
• 51c2e1fcef [CI/Build] Split up models tests (#10069) Cyrus Leung 2024-11-10 03:39:14 +08:00
• b09895a618 [Frontend][Core] Override HF config.json via CLI (#5836) Krishna MandalandDarkLight1337 2024-11-09 08:19:27 -08:00
• d88bff1b96 [Frontend] add add_request_id middleware (#9594) cjackal 2024-11-09 19:18:29 +09:00
• 9e37266420 bugfix: fix the bug that stream generate not work (#2756) Zhao Yingzhuo 2024-11-09 18:09:48 +08:00
• 8a4358ecb5 [doc] explaining the integration with huggingface (#10173) youkaichao 2024-11-09 01:02:54 -08:00
• bd46357ad9 [bugfix] fix broken tests of mlp speculator (#10177) youkaichao 2024-11-09 00:04:50 -08:00
• f192aeba74 [Bugfix] Enable some fp8 and quantized fullgraph tests (#10171) bnellnm 2024-11-09 03:01:27 -05:00
• 8e1529dc57 [CI/Build] Add run-hpu-test.sh script (#10167) Chendi.Xue 2024-11-09 00:26:52 -06:00
• 1a95f10ee7 [5/N] pass the whole config to model (#9983) youkaichao 2024-11-08 22:17:28 -08:00
• 49d2a41a86 [Doc] Adjust RunLLM location (#10176) Cyrus Leung 2024-11-09 12:07:10 +08:00
• 47672f38b5 [CI/Build] Fix VLM broadcast tests tensor_parallel_size passing (#10161) Isotr0py 2024-11-09 12:02:59 +08:00
• f83feccd7f [Bugfix] Ignore GPTQ quantization of Qwen2-VL visual module (#10169) Michael Goin 2024-11-08 22:36:46 -05:00
• e0191a95d8 [0/N] Rename MultiModalInputs to MultiModalKwargs (#10040) Cyrus Leung 2024-11-09 11:31:02 +08:00
• d7edca1dee [CI/Build] Adding timeout in CPU CI to avoid CPU test queue blocking (#6892) Li, JiangandDarkLight1337 2024-11-09 11:27:11 +08:00
• 127c07480e [Kernel][Triton] Add Triton implementation for scaled_mm_triton to support fp8 and int8 SmoothQuant, symmetric case (#9857) rasmith 2024-11-08 18:59:22 -06:00
• 10b67d865d [Bugfix] SymIntArrayRef expected to contain concrete integers (#10170) bnellnm 2024-11-08 17:44:18 -05:00
• 4f93dfe952 [torch.compile] Fuse RMSNorm with quant (#9138) Luka Govedičandyoukaichao 2024-11-08 16:20:08 -05:00
• e1b5a82179 Rename vllm.logging to vllm.logging_utils (#10134) Florian Zimmermeister 2024-11-08 21:53:24 +01:00
• 87713c6053 [CI/Build] Ignore .gitignored files for shellcheck (#10162) Luka Govedič 2024-11-08 14:53:36 -05:00
• b5815c8413 [V1] Fix non-cudagraph op name (#10166) Woosuk Kwon 2024-11-08 10:23:04 -08:00
• 6b30471586 [Misc] Improve Web UI (#10090) Rafael Vasquez 2024-11-08 12:51:04 -05:00
• f6778620a9 Disable spec-decode + chunked-prefill for draft models with tensor parallelism > 1 (#10136) sroy745 2024-11-08 07:56:18 -08:00
• 0535e5fe6c Fix edge case Mistral tokenizer (#10152) Patrick von Platen 2024-11-08 16:42:27 +01:00
• b489fc3c91 [CI/Build] Update CPU tests to include all "standard" tests (#5481) Cyrus Leung 2024-11-08 23:30:04 +08:00
• 208ce622c7 [V1]Enable APC by default only for text models (#10148) Roger Wang 2024-11-08 06:39:41 -08:00
• 1ff4aed5bd [Model] Expose size to Idefics3 as mm_processor_kwargs (#10146) Isotr0py 2024-11-08 17:56:58 +08:00
• f10797c0ce [Bugfix][XPU] Fix xpu tp by introducing XpuCommunicator (#10144) Yan Ma 2024-11-08 17:41:03 +08:00
• f4c2187e29 [Misc] Fix typo in #5895 (#10145) Cyrus Leung 2024-11-08 17:07:01 +08:00
• aea6ad629f Add hf_transfer to testing image (#10096) Michael Goin 2024-11-08 03:35:25 -05:00
• da07a9ead7 Fixes a typo about 'max_decode_seq_len' which causes crashes with cuda graph. (#9285) Tao He 2024-11-08 13:31:28 +08:00
• 3a7f15a398 [Doc] Move CONTRIBUTING to docs site (#9924) Russell Bryant 2024-11-08 00:15:12 -05:00
• 7371749d54 [Misc] Fix ImportError causing by triton (#9493) Mengqing Cao 2024-11-08 13:08:51 +08:00
• ad39bd640c [Bugfix] Add error handling when server cannot respond any valid tokens (#5895) DearPlanet 2024-11-08 12:58:37 +08:00
• 40d0e7411d [Doc] Update FAQ links in spec_decode.rst (#9662) whyiug 2024-11-08 12:44:58 +08:00
• 6bb52b0f97 [CI/Build] Give PR cleanup job PR write access (#10139) Russell Bryant 2024-11-07 23:10:20 -05:00
• 201fc07730 [V1] Prefix caching (take 2) (#9972) Cody Yu 2024-11-07 17:34:44 -08:00
• 42b4f46b71 [V1] Add all_token_ids attribute to Request (#10135) Woosuk Kwon 2024-11-07 17:08:24 -08:00
• 073a472728 [Misc] report relevant env vars in collect_env.py tool (#9293) Jiangtao Hu 2024-11-07 16:14:01 -08:00
• 93bff421bc Bump actions/checkout from 4.2.1 to 4.2.2 (#9746) dependabot[bot]anddependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> 2024-11-07 21:44:58 +00:00
• 28b2877d30 Online video support for VLMs (#10020) 3 people 2024-11-08 04:25:59 +08:00
• 97b8475beb Bump actions/setup-python from 5.2.0 to 5.3.0 (#9745) dependabot[bot]anddependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> 2024-11-07 18:55:35 +00:00
• a2f1f3b089 [CI/Build] Automate PR body text cleanup (#10082) Russell Bryant 2024-11-07 13:26:28 -05:00
• 3be5b26a76 [CI/Build] Add shell script linting using shellcheck (#7925) Russell Bryant 2024-11-07 13:17:29 -05:00
• de0e61a323 [CI/Build] Always run mypy (#10122) Russell Bryant 2024-11-07 11:43:16 -05:00
• 9d43afcc53 [Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291) Nicolò Lucchesi 2024-11-07 17:15:14 +01:00
• ae62fd17c0 [Frontend] Tool calling parser for Granite 3.0 models (#9027) Maximilien de Bayser 2024-11-07 12:09:02 -03:00
• a62bc0109c [Misc] Add Gamma-Distribution Request Generation Support for Serving Benchmark. (#10105) AtlasandRoger Wang 2024-11-07 19:20:30 +08:00
• 999df95b4e [Bugfix] Make image processor respect mm_processor_kwargs for Qwen2-VL (#10112) Jiahao Li 2024-11-07 18:50:44 +08:00
• a6f332d0d9 [Hardware][CPU][bugfix] Fix half dtype support on AVX2-only target (#10108) Li, Jiang 2024-11-07 18:42:50 +08:00
• 0dfba97b42 [Frontend] Fix multiple values for keyword argument error (#10075) (#10076) Lei Yang 2024-11-07 17:07:19 +08:00
• aa9078fa03 Adds method to read the pooling types from model's files (#9506) Flávia BéoandMax de Bayser 2024-11-07 05:42:40 -03:00
• e036e527a0 [CI/Build] Improve mypy + python version matrix (#10041) Russell Bryant 2024-11-07 02:54:16 -05:00
• 6192e9b8fe [Core][Distributed] Refactor ipc buffer init in CustomAllreduce (#10030) Hanzhi Zhou 2024-11-06 23:50:47 -08:00
• d7263a1bb8 Doc: Improve benchmark documentation (#9927) Rafael Vasquez 2024-11-07 02:50:35 -05:00
• 104d729656 [CI/Build] re-add codespell to CI (#10083) Russell Bryant 2024-11-07 01:54:46 -05:00
• db7db4aab9 [Misc] Consolidate ModelConfig code related to HF config (#10104) Cyrus Leung 2024-11-07 14:00:21 +08:00
• 1fa020c539 [V1][BugFix] Fix Generator construction in greedy + seed case (#10097) Nick Hill 2024-11-07 05:06:57 +00:00
• e7b84c394d [doc] add back Python 3.8 ABI (#10100) youkaichao 2024-11-06 21:06:41 -08:00
• a4b3e0c1e9 [Hardware][CPU] Update torch 2.5 (#9911) Li, Jiang 2024-11-07 12:43:08 +08:00
• 29862b884b [Frontend] Adjust try/except blocks in API impl (#10056) Nick Hill 2024-11-07 04:07:51 +00:00
• d3859f1891 [Misc][XPU] Upgrade to Pytorch 2.5 for xpu backend (#9823) Yan MaandKunshang Ji 2024-11-07 09:29:03 +08:00
• 4ab3256644 [Bugfix] Fix FP8 torch._scaled_mm fallback for torch>2.5 with CUDA<12.4 (#10095) Michael Goin 2024-11-06 19:54:13 -05:00
• 719c1ca468 [core][distributed] add stateless_init_process_group (#10072) youkaichao 2024-11-06 16:42:09 -08:00
• 74f2f8a0f1 [CI/Build] Always run the ruff workflow (#10092) Russell Bryant 2024-11-06 17:25:23 -05:00
• d58268c56a [V1] Make v1 more testable (#9888) Joe Runde 2024-11-06 12:57:35 -07:00
• 87bd7e0515 [CI/Build] change conflict PR comment from mergify (#10080) Russell Bryant 2024-11-06 13:15:42 -05:00
• 098f94de42 [CI/Build] Drop Python 3.8 support (#10038) Russell BryantandDarkLight1337 2024-11-06 09:31:01 -05:00
• 399c798608 Remove ScaledActivation for AWQ (#10057) Michael Goin 2024-11-06 09:27:06 -05:00
• 406d4cc480 [Model][LoRA]LoRA support added for Qwen2VLForConditionalGeneration (#10022) Eric 2024-11-06 22:13:15 +08:00
• a5bba7d234 [Model] Add Idefics3 support (#9767) Jee Jee LiandB-201 2024-11-06 19:41:17 +08:00
• 2003cc3513 [Model][LoRA]LoRA support added for LlamaEmbeddingModel (#10071) Jee Jee Li 2024-11-06 17:49:19 +08:00
• 6a585a23d2 [Hotfix] Fix ruff errors (#10073) Woosuk Kwon 2024-11-06 01:24:28 -08:00
• a02a50e6e5 [Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143) +2636 people 2024-11-06 10:09:10 +01:00
• a5fda50a10 [CI/Build] Fix large_gpu_mark reason (#10070) Isotr0py 2024-11-06 16:50:37 +08:00
• 21063c11c7 [CI/Build] drop support for Python 3.8 EOL (#8464) Aaron Pham 2024-11-06 02:11:55 -05:00
• 4be3a45158 [distributed] add function to create ipc buffers directly (#10064) youkaichao 2024-11-05 22:35:03 -08:00
• 4089985552 [V1] Integrate Piecewise CUDA graphs (#10058) Woosuk Kwon 2024-11-05 22:16:04 -08:00
• 9d59b75593 [Bugfix] Remove CustomChatCompletionContentPartParam multimodal input type (#10054) zifeitong 2024-11-05 21:13:09 -08:00
• ea928f608c [Bugfix] Gpt-j-6B patch kv_scale to k_scale path (#10063) arakowsk-amd 2024-11-05 21:10:40 -08:00
• 2bcbae704c [Bugfix] Fix edge-case crash when using chat with the Mistral Tekken Tokenizer (#10051) Travis Johnson 2024-11-05 21:28:29 -07:00
• ffc0f2b47a [Model][OpenVINO] Fix regressions from #8346 (#10045) Peter Salas 2024-11-05 20:19:15 -08:00
• 82bfc38d07 [Misc] Sort the list of embedding models (#10037) Cyrus Leung 2024-11-06 12:05:05 +08:00
• c4cacbaa7f [v1] reduce graph capture time for piecewise cudagraph (#10059) youkaichao 2024-11-05 18:19:50 -08:00
• 0c63c34f72 [Bugfix][SpecDecode] kv corruption with bonus tokens in spec decode (#9730) Sungjae LeeandLiuXiaoxuanPKU 2024-11-06 10:45:45 +09:00
• 966e31697b [Bugfix] Fix pickle of input when async output processing is on (#9931) Wallas Henrique 2024-11-05 21:39:26 -03:00
• 43300bd98a [Bugfix] Properly propagate trust_remote_code settings (#10047) zifeitong 2024-11-05 16:34:40 -08:00
• ca9844b340 [bugfix] fix weak ref in piecewise cudagraph and tractable test (#10048) youkaichao 2024-11-05 14:49:20 -08:00
• 235366fe2e [CI] Prune back the number of tests in tests/kernels/* (#9932) Michael Goin 2024-11-05 16:02:32 -05:00
• 02462465ea [CI] Prune tests/models/decoder_only/language/* tests (#9940) Michael Goin 2024-11-05 16:02:23 -05:00
• b9c64c0ca7 [Misc] Modify BNB parameter name (#9997) Jee Jee Li 2024-11-06 03:40:08 +08:00
• d2e80332a7 [Feature] Update benchmark_throughput.py to support image input (#9851) lkchenandLinkun Chen 2024-11-05 11:30:02 -08:00
• a53046b16f [Model] Support quantization of PixtralHFTransformer for PixtralHF (#9921) Michael Goin 2024-11-05 13:42:20 -05:00
• 731aec5be7 [CI/Build] Limit github CI jobs based on files changed (#9928) Russell Bryant 2024-11-05 13:30:42 -05:00
• 09d3550372 [Misc] Add logging for CUDA memory (#10027) 3 people 2024-11-05 11:50:50 -06:00
• cd34029e91 Refactor TPU requirements file and pin build dependencies (#10010) Richard Liu 2024-11-05 08:48:44 -08:00
• 5952d81139 [Frontend] Fix tcp port reservation for api server (#10012) Russell Bryant 2024-11-05 10:50:57 -05:00
• 93dee88f6b [Misc] vllm CLI flags should be ordered for better user readability (#10017) Chauncey 2024-11-05 18:59:56 +08:00
• 7a83b1aec0 [BugFix] Lazy import ray (#10021) Gene Der Su 2024-11-05 02:04:10 -08:00