Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86

Mono Color

• 61f412187d [Bugfix] Re-enable Gemma3 for V1 (#14980) Cyrus Leung 2025-03-19 14:58:22 +08:00
• 05ccd0aa35 [V1] Ensure using int64 for sampled token ids (#15065) Woosuk Kwon 2025-03-18 23:52:19 -07:00
• f690372b68 [Core] Update dtype detection and defaults (#14858) Cyrus Leung 2025-03-19 13:49:33 +08:00
• 8b3e94a357 [Model] Remove duplicated message check in Mistral chat completion request (#15069) Brayden Zhong 2025-03-19 01:09:32 -04:00
• 437f9162d0 [Model] Pixtral: Remove layer instantiation duplication (#15053) Julien Denize 2025-03-19 03:34:03 +01:00
• 4f065f12f5 [Misc][V1] Skip device checking if not available (#15061) Cody Yu 2025-03-18 19:33:43 -07:00
• 228b768db6 [Doc] Minor v1_user_guide update (#15064) Jennifer ZhaoandRoger Wang 2025-03-18 16:10:45 -07:00
• 027827cc1d fix long dtype in topk sampling (#15049) Chujie Zheng 2025-03-19 06:57:31 +08:00
• 72a8639b68 [V1] TPU - CI/CD use smaller model (#15054) Alexander Matveev 2025-03-18 17:39:21 -04:00
• 99abb8b650 [V1][Spec Decode] Optimize Rejection Sampler with Triton Kernels (#14930) Woosuk Kwon 2025-03-18 14:31:54 -07:00
• 3a1e648158 [V1] Refactor Structured Output for multiple backends (#14694) Russell Bryant 2025-03-18 15:49:15 -04:00
• 46c759c165 [Bugfix] Fix LoRA extra vocab size (#15047) Jee Jee Li 2025-03-19 00:40:29 +08:00
• 179a619c21 [Bugfix] Fix broken CPU quantization due to triton import (#15038) Isotr0py 2025-03-18 23:57:39 +08:00
• 452e8fd968 [MODEL] Add support for Zamba2 models (#13185) 4 people 2025-03-18 08:56:21 -07:00
• 8b793f7ec6 MI325 configs, fused_moe_kernel bugfix (#14987) ekuznetsov139 2025-03-18 08:05:18 -07:00
• af35d3a3cc [TPU][V1][Bugfix] Fix chunked prefill with padding (#15037) Nicolò Lucchesi 2025-03-18 15:34:45 +01:00
• 3b457143d2 [Bugfix] Register serializers for V0 MQ Engine (#15009) Simon Mo 2025-03-18 06:14:47 -07:00
• ab656f2c2f [Bugfix] Loosen type check to avoid errors in V1 (#15021) Cyrus Leung 2025-03-18 20:54:40 +08:00
• 64fc2193dc [Misc][Docs] fix the comments of KV_T and CACHE_T in CALL_RESHAPE_AND_CACHE_XX macros (#14347) Serena 2025-03-18 20:50:19 +08:00
• dd732028f5 [Bugfix][Frontend] Fix validation of logprobs in ChatCompletionRequest (#14352) Sebastian Schoennenbeck 2025-03-18 13:50:05 +01:00
• 414919138b [Bugfix] torchrun compatibility (#14899) hoshi-hiyougaandyoukaichao 2025-03-18 20:49:27 +08:00
• db7c8ca910 [Misc] Embedding model support LoRA (#14935) Jee Jee Li 2025-03-18 20:07:00 +08:00
• f863ffc965 [Mistral-Small 3.1] Update docs and tests (#14977) Patrick von PlatenandRoger Wang 2025-03-18 11:29:42 +01:00
• 400d483e87 [Kernels] LoRA - Retire SGMV and BGMV Kernels (#14685) Varun Sundar RabindranathandVarun Sundar Rabindranath 2025-03-18 05:47:53 -04:00
• d1695758b2 [Doc][V1] Fix V1 APC doc (#14920) Shanshan Shen 2025-03-18 16:15:46 +08:00
• 53a0cf8b95 [Neuron] trim attention kernel tests to fit trn1.2x instance (#14988) Liangfu Chen 2025-03-18 00:05:52 -07:00
• 5eeabc2a44 [Bugfix] Fix bnb quantization for models with both HF-format and Mistral-format weights (#14950) Tristan Leclercq 2025-03-18 00:27:26 +01:00
• 18551e820c [V1] TPU - Fix CI/CD runner (#14974) Alexander Matveev 2025-03-17 17:07:07 -04:00
• e41e160263 [V1] Guard Against Main Thread Usage (#14972) Robert Shaw 2025-03-17 16:23:02 -04:00
• b89fb2a4a1 [CI/Build] Use AutoModelForImageTextToText to load VLMs in tests (#14945) Cyrus Leung 2025-03-18 02:35:17 +08:00
• 5340b0e221 [Bugfix] Fix interface for Olmo2 on V1 (#14976) Roger Wang 2025-03-17 11:26:38 -07:00
• 37e3806132 [Bugfix] Make Gemma3 MM V0 only for now (#14971) Roger Wang 2025-03-17 10:04:21 -07:00
• c0efdd655b [Fix][Structured Output] using vocab_size to construct matcher (#14868) 4 people 2025-03-17 11:42:45 -04:00
• aaaec52ad9 [Bugfix][Model] Mixtral: use unused head_dim config argument (#14961) Quentin 2025-03-17 15:44:18 +01:00
• e1eb45d397 [Bugfix] Fix precommit - line too long in pixtral.py (#14960) Tyler Michael SmithandDarkLight1337 2025-03-17 10:18:50 -04:00
• 89fca671fb [V1] Default MLA to V1 (#14921) Simon Mo 2025-03-17 06:54:40 -07:00
• d20b0c139c Add patch merger (#14957) Patrick von Platen 2025-03-17 14:47:50 +01:00
• 166a168b0f [Doc] Fix misleading log during multi-modal profiling (#14955) Cyrus Leung 2025-03-17 21:14:32 +08:00
• 2bb0e1a799 [Bugfix][ROCm] running new process using spawn method for rocm in tests. (#14810) 3 people 2025-03-17 19:33:35 +08:00
• 6eaf1e5c52 [Misc] Add --seed option to offline multi-modal examples (#14934) Cyrus Leung 2025-03-17 18:00:17 +08:00
• 868a8c5b2c [Bugfix] Fix Ultravox on V1 (#14929) Cyrus Leung 2025-03-17 17:15:20 +08:00
• b4ad56c1bd [V1][TPU] Apply the ragged paged attention kernel fix and remove the padding. (#14846) iefgnoix 2025-03-17 01:48:28 -07:00
• 69698f257e fix minor miscalled method (#14327) kushanam 2025-03-17 01:47:58 -07:00
• cd0cd85102 [MISC] More AMD unused var clean up (#14926) Lu Fang 2025-03-17 01:40:41 -07:00
• 0a74bfce9c setup.py: drop assumption about local main branch (#14692) Russell Bryant 2025-03-17 04:37:42 -04:00
• dd3b865854 [Doc] Add vLLM Beijing meetup slide (#14938) Chen Zhang 2025-03-17 16:29:36 +08:00
• 9b87a579aa [Misc][XPU] Use None as device capacity for XPU (#14932) Yan Ma 2025-03-17 16:22:14 +08:00
• b539222d4e [V1] Remove input cache client (#14864) Cyrus LeungandRoger Wang 2025-03-17 14:42:06 +08:00
• 8d6cf89526 [V1] [Spec Decode] Support random sampling for spec decode (#13933) Lily LiuandWoosuk Kwon 2025-03-16 22:00:20 -07:00
• 583a9778e0 [Benchmark] Do not save detailed info to json by default (#14879) Simon Mo 2025-03-16 21:48:11 -07:00
• a73e183e36 [Misc] Replace os environ to monkeypatch in test suite (#14516) 3 people 2025-03-17 11:35:57 +08:00
• 1e799b7ec1 [BugFix] Fix MLA + V1 + TP==1 causing reinitialization of cuda context (#14910) Lucas Wilkinson 2025-03-16 23:35:37 -04:00
• 7f6c5ee06c [V1][Minor] Add __repr__ to ConstantList (#14907) Woosuk Kwon 2025-03-16 20:20:15 -07:00
• faa0275730 [V1] Optimize the overhead of rewinding (#14905) Woosuk Kwon 2025-03-16 20:19:30 -07:00
• 8a5a9b70d7 [CI/Build] Update defaults for test reproducibility (#14893) Cyrus Leung 2025-03-17 10:38:15 +08:00
• bb3aeddfaf [CI] Nightly Tests (#14898) Robert Shawandrshaw@neuralmagic.com <rshaw@neuralmagic.com> 2025-03-16 22:06:43 -04:00
• aecc780dba [V1] Enable Entrypoints Tests (#14903) Robert Shaw 2025-03-16 20:56:16 -04:00
• 90df7f23aa [Doc] Add guidance for using ccache with pip install -e . in doc (#14901) Vadim Gimpelson 2025-03-17 03:10:04 +04:00
• b9b5bdfc7d [Misc] Catching Ray Compiled Graph PP test failures for V1 (#14847) Rui Qiao 2025-03-16 15:46:42 -07:00
• 31060b2757 [V1][BugFix] Detect interleaved sliding window attention (#14896) Woosuk Kwon 2025-03-16 14:53:53 -07:00
• fc1f67715d [BugFix][V1] Fix overhead related to bad_words sampling when not in use (#14894) Nick Hill 2025-03-16 14:53:34 -07:00
• f6137adbcb Revert "[Bugfix] Limit profiling run sequence length by max_model_len (#14785) (#14892) Cyrus Leung 2025-03-17 00:13:46 +08:00
• e53b1350f2 [Bugfix] Explicitly disable Phi-4-multimodal in V1 (#14889) Cyrus Leung 2025-03-17 00:05:40 +08:00
• d30aa7e9e6 [Bugfix] Limit profiling run sequence length by max_model_len (#14785) Kyle Sayers 2025-03-16 10:44:19 -04:00
• d1ad2a57af [V1] [Spec Decode] Fix ngram tests (#14878) Lily Liu 2025-03-16 00:29:22 -07:00
• b82662d952 [BugFix] Fix torch distributed stateless PG backend init (#14870) Nick Hill 2025-03-15 20:26:19 -07:00
• 71c1e07107 [Kernel] Add more tuned configs (#14877) Simon Mo 2025-03-15 20:25:03 -07:00
• b30c75dda4 [V1] Remove V0 fallback for mistral-tokenizer (#14873) Roger Wang 2025-03-15 20:21:11 -07:00
• def232e122 [VLM] Clean up Phi-4-MM ViT implementation (#14812) Isotr0pyandCyrus Leung 2025-03-16 09:53:52 +08:00
• 3453b964a3 [Misc][Doc] Minor benchmark README update (#14874) Roger Wang 2025-03-15 18:46:17 -07:00
• 61c6a5a796 [VLM] Merged multi-modal processor for Pixtral (#12211) Rémi DelacourtandDarkLight1337 2025-03-15 14:28:27 +01:00
• 74bc397b0a [Core] Expose API endpoint /is_sleeping (#14312) Jun Duan 2025-03-15 09:28:14 -04:00
• f58aea002c [CI][Intel GPU] refine intel GPU ci docker build (#14860) Kunshang Ji 2025-03-15 04:58:53 -07:00
• 3556a41434 [VLM] Limit multimodal input cache by memory (#14805) Cyrus Leung 2025-03-15 17:52:05 +08:00
• 9ed6ee92d6 [Bugfix] EAGLE output norm bug (#14464) Bryan Lu 2025-03-14 23:50:33 -07:00
• ee3778d5fc [Build/CI] Upgrade jinja2 to get 3 moderate CVE fixes (#14839) Russell Bryant 2025-03-15 01:38:19 -04:00
• aaacf17324 [Doc] V1 user guide (#13991) 6 people 2025-03-14 22:17:59 -07:00
• 4c7629cae9 [V1][Structured Output] calculate vocab_size eagerly (#14851) Aaron Pham 2025-03-15 01:09:51 -04:00
• e0fdfa1608 [CI/Build] Delete LoRA bias test (#14849) Jee Jee Li 2025-03-15 13:09:25 +08:00
• 5952d8ab61 [Attention] Get rid of mla cache alignment (#14842) Lucas Wilkinson 2025-03-15 01:08:25 -04:00
• a2ae496589 [CPU] Support FP8 KV cache (#14741) Li, Jiang 2025-03-15 13:07:36 +08:00
• 877e352262 [Docs] Add new East Coast vLLM Meetup slides to README and meetups.md (#14852) Simon Mo 2025-03-14 22:06:38 -07:00
• d4d93db2c5 [V1] V1 Enablement Oracle (#13726) 5 people 2025-03-15 01:02:20 -04:00
• 8c0d15d5c5 [Misc][Easy] Annotate unused vars in the csrc files (#14798) Lu Fang 2025-03-14 21:40:09 -07:00
• 97ac781c62 [Misc] Remove misleading message in gemma2 and gemma3 (#14850) Isotr0py 2025-03-15 12:35:12 +08:00
• 776dcec8fe Disable outlines cache by default (#14837) Russell Bryant 2025-03-14 23:57:55 -04:00
• ccf02fcbae Revert "[Model] Mamba2 Prefill Performance Tweaks: Fixing Flurry of U… (#14848) Tyler Michael Smith 2025-03-14 23:45:42 -04:00
• acaea3bb07 [Bugfix][V1] Fix flashinfer sampling (#14815) DefTruth 2025-03-15 11:42:38 +08:00
• 9f37422779 [Neuron][CI] update docker run command (#14829) Liangfu Chen 2025-03-14 18:51:35 -07:00
• dd344e0342 [Bugfix] Fix torch_xla in V0 which can't handle None seed introduced … (#14844) yarongmu-google 2025-03-14 17:41:15 -07:00
• 54a8804455 [Doc] More neutral K8s deployment guide (#14084) Yuan Tang 2025-03-14 19:12:36 -04:00
• bbd94a19fc [Build/CI] Upgrade aiohttp to incldue CVE fix (#14840) Russell Bryant 2025-03-14 19:11:28 -04:00
• 233ffce1eb [Build/CI] Move ninja to common deps (#14835) Russell Bryant 2025-03-14 17:25:28 -04:00
• 40677783aa [CI] Add TPU v1 test (#14834) Richard Liu 2025-03-14 14:13:30 -07:00
• 14f301b541 Update to torch==2.6.0 (#12721) 5 people 2025-03-14 16:58:30 -04:00
• 46f98893dd [V1] Fix model parameterization for structured output tests (#14833) Russell Bryant 2025-03-14 16:55:18 -04:00
• fe66b34728 [Model] Mamba2 Prefill Performance Tweaks: Fixing Flurry of Unnecessary Memory Copies (#14778) Chih-Chieh Yang 2025-03-14 16:36:18 -04:00
• 270a5da495 Re-enable the AMD Entrypoints Test (#14711) Alexei-V-Ivanov-AMD 2025-03-14 14:18:13 -05:00
• 7097b4cc1c [release] Remove log cleanup commands from TPU job (#14838) Kevin H. Luu 2025-03-14 11:59:52 -07:00
• 977a16772c [Bugfix][Kernel]: Fix AllSpark kernel compilation errors and enable for CUDA < 12.0 (#14430) Yajie Wang 2025-03-15 00:55:14 +08:00