Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86

Mono Color

• 1c3198b6c4 [Model] Consolidate pooler implementations (#20927) Cyrus Leung 2025-07-16 21:39:13 +08:00
• 260127ea54 [Docs] Add intro and fix 1-2-3 list in frameworks/open-webui.md (#19199) Michael Yao 2025-07-16 21:11:38 +08:00
• d0dc4cfca4 Fix inadvertently silenced PP tests for mp, add DeepSeek V2/V3 model family to PP tests (#20831) Seiji Eicher 2025-07-16 00:14:49 -07:00
• d31a647124 [BugFix] Fix import error on non-blackwell machines (#21020) Lucas Wilkinson 2025-07-16 01:27:29 -04:00
• 85431bd9ad [TPU] fix kv_cache_update kernel block size choosing logic (#21007) Chengji Yao 2025-07-15 21:39:48 -07:00
• c11013db8b [Meta] Llama4 EAGLE Support (#20591) zhiweizandqizixi 2025-07-15 21:14:15 -07:00
• 1eb2b9c102 [CI] update typos config for CI pre-commit and fix some spells (#20919) Peter Pan 2025-07-16 12:12:40 +08:00
• 6ebf313790 Avoid direct comparison of floating point numbers (#21002) Maximilien de Bayser 2025-07-16 01:12:14 -03:00
• cfbcb9ed87 [Voxtral] Add more tests (#21010) Patrick von Platenandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2025-07-16 06:11:49 +02:00
• 76ddeff293 [Doc] Remove duplicate docstring (#21012) Wentao Ye 2025-07-15 23:09:13 -04:00
• f46098335b [Bugfix] Fix Mistral3 support on SM100/SM120 (#20998) Michael Goin 2025-07-15 23:08:41 -04:00
• e9534c7202 [CI][HPU] update for v0 deprecate by switching to VLLM_TARGET_DEVICE=empty (#21006) Chendi.Xue 2025-07-15 22:07:05 -05:00
• 7976446015 Add Dockerfile argument for VLLM_USE_PRECOMPILED environment (#20943) Doug Smith 2025-07-15 22:53:57 -04:00
• fcb9f879c1 [Bugfix] Correct per_act_token in CompressedTensorsW8A8Fp8MoECutlassM… (#20937) Ming Yang 2025-07-15 19:53:42 -07:00
• 3ed94f9d0a [Docs] Enhance Anyscale documentation, add quickstart links for vLLM (#21018) Ricardo Decal 2025-07-15 22:46:56 -04:00
• fa839565f2 [Misc] Refactor: Improve argument handling for conda command (#20481) Reid 2025-07-16 10:43:19 +08:00
• 75a99b98bf [Chore] Remove outdated transformers check (#20989) Brayden Zhong 2025-07-15 22:42:40 -04:00
• b5c3b68359 [Misc] bump xgrammar version to v0.1.21 (#20992) Chauncey 2025-07-16 10:42:16 +08:00
• 6cbc4d4bea [Model] Add ModelConfig class for GraniteMoeHybrid to override default max_seq_len_to_capture (#20923) Thomas Parnell 2025-07-16 04:19:10 +02:00
• 153c6f1e61 [Frontend] Remove print left in FrontendArgs.add_cli_args (#21004) Michael Goin 2025-07-15 22:18:41 -04:00
• 34cda778a0 [Frontend] OpenAI Responses API supports input image (#20975) Chauncey 2025-07-16 08:59:36 +08:00
• 30800b01c2 [Nvidia] Integrate SM100 cudnn prefill API to MLA prefill (#20411) Elfie GuoandElfie Guo 2025-07-15 17:56:45 -07:00
• 10be209493 [Bug Fix] get_distributed_init_method should get the ip from get_ip i… (#20889) Chen LIandRussell Bryant 2025-07-15 14:23:52 -07:00
• 19c863068b [Frontend] Support cache_salt in /v1/completions and /v1/responses (#20981) Marko Rosenmueller 2025-07-15 23:01:04 +02:00
• f29fd8a7f8 [BugFix] fix 3 issues: (1) using metadata for causal-conv1d, (2) indexing overflow in v1 vLLM, and (3) init_states in v0 (#20838) Tuan, Hoang-TrongandTuan M. Hoang-Trong 2025-07-15 16:08:26 -04:00
• ed10f3cea1 [ROCm] warpSize is being made non constexpr in ROCm 7.0 (#20330) Gregory Shtrasberg 2025-07-15 14:01:44 -04:00
• b637e9dcb8 Add full serve CLI reference back to docs (#20978) Harry Mellor 2025-07-15 18:42:30 +01:00
• 1e36c8687e [Deprecation] Remove nullable_kvs (#20969) Harry Mellor 2025-07-15 18:21:50 +01:00
• 5bac61362b Configure Gemini (#20971) Harry Mellor 2025-07-15 17:37:05 +01:00
• 313ae8c16a [Deprecation] Remove everything scheduled for removal in v0.10.0 (#20979) Harry Mellor 2025-07-15 16:57:53 +01:00
• c847e34b39 [CI/Build] Fix wrong path in Transformers Nightly Models Test (#20994) Cyrus Leung 2025-07-15 23:53:16 +08:00
• e7e3e6d263 Voxtral (#20970) Patrick von PlatenandCyrus Leung 2025-07-15 16:35:30 +02:00
• 4ffd963fa0 [v1][core] Support for attention free models (#20811) Christian Pinto 2025-07-15 15:20:01 +01:00
• 56fe4bedd6 [Deprecation] Remove TokenizerPoolConfig (#20968) Harry Mellor 2025-07-15 15:00:50 +01:00
• d91278181d [doc] Add more details for Ray-based DP (#20948) Rui Qiao 2025-07-15 05:37:12 -07:00
• 20149d84d9 [MISC] Add init files for python package (#20908) Li Wang 2025-07-15 20:16:33 +08:00
• 3534c39a20 [V1] [Hybrid] Refactor mamba state shape calculation; enable V1 via cli (#20840) Thomas Parnell 2025-07-15 13:04:35 +02:00
• c586b55667 [TPU] Optimize kv cache update kernel (#20415) Yifei Teng 2025-07-15 03:56:43 -07:00
• 33d560001e [Docs] Improve documentation for ray cluster launcher helper script (#20602) Ricardo Decal 2025-07-15 06:55:45 -04:00
• f148c44c6a [frontend] Refactor CLI Args for a better modular integration (#20206) kourosh hakhamaneshi 2025-07-15 02:23:42 -07:00
• 235bfd5dfe [Docs] Improve documentation for RLHF example (#20598) Ricardo Decal 2025-07-15 04:54:10 -04:00
• 68d28e37b0 [frontend] Add --help=page option for paginated help output (#20961) Reid 2025-07-15 15:42:00 +08:00
• 37a7d5d74a [Misc] Refactor AllReduceFusionPass. Remove parameter (#20918) Ilya Markovandilmarkov 2025-07-15 08:57:40 +02:00
• d4d309409f Implement Async Scheduling (#19970) Woosuk Kwon 2025-07-14 23:01:46 -07:00
• 85bd6599e4 [Model] Add AutoWeightsLoader support for BERT, RoBERTa (#20534) Jennifer He 2025-07-15 01:34:24 -04:00
• 91b3d190ae [cold start] replace VLLM_COMPILE_DEPYF with debug_dump_dir (#20940) Boyuan Feng 2025-07-14 22:02:17 -07:00
• fc017915f5 [Doc] Clearer mistral3 and pixtral model support description (#20926) Isotr0py 2025-07-15 12:56:53 +08:00
• 9ad0a4588b [Bugfix] Switch bailout logic for kv-cache-dtype with SM100 Flashinfer (#20934) Pavani Majety 2025-07-14 20:27:50 -07:00
• 016b8d1b7f Enabled BnB NF4 inference on Gaudi (#20172) Ruheena Suhani Shaik 2025-07-15 08:56:08 +05:30
• 80305c1b24 [CI] Fix flaky test_streaming_response test (#20913) Nicolò Lucchesi 2025-07-15 05:15:15 +02:00
• 37e2ecace2 feat: add image zoom to improve image viewing experience (#20763) Reid 2025-07-15 11:14:23 +08:00
• 054c8657e3 [Docs] Add Kuberay to deployment integrations (#20592) Ricardo Decal 2025-07-14 23:13:55 -04:00
• d4170fad39 Use w8a8 quantized matmul Pallas kernel (#19170) XiongfeiWei 2025-07-14 20:06:33 -07:00
• 946aadb4a0 [CI/Build] Split Entrypoints Test into LLM and API Server (#20945) Michael Goin 2025-07-15 11:44:18 +09:00
• bcdfb2a330 [Bugfix] Fix incorrect dispatch for CutlassBlockScaledGroupedGemm and DeepGEMM (#20933) Michael Goin 2025-07-15 10:42:17 +09:00
• ba8c300018 [BugFix] VLLM_DISABLE_COMPILE_CACHE=1 should disable all reads and writes from the cache (#20942) Richard Zou 2025-07-14 21:26:18 -04:00
• 8cdc371217 SM100 Cutlass MLA decode with unrestricted num_heads (< 128) for DeepSeek TP (#20769) Alexander Matveev 2025-07-14 21:06:38 -04:00
• 61e20828da Fall back if flashinfer comm module not found (#20936) Yong Hoon Shin 2025-07-14 16:11:18 -07:00
• 55e1c66da5 [Docs] remove outdated performance benchmark (#20935) Kuntai Du 2025-07-14 15:14:17 -07:00
• 86f3ac21ce Fix overflow indexing in causal_conv1d kernel (#20938) Thomas Parnell 2025-07-14 23:43:07 +02:00
• 149f2435a5 [Misc] Relax translations tests (#20856) Nicolò Lucchesi 2025-07-14 22:08:36 +02:00
• c0569dbc82 [Misc] ModularKernel : Perform WeightAndReduce inside TritonExperts & DeepGemmExperts (#20725) Varun Sundar RabindranathandVarun Sundar Rabindranath 2025-07-15 01:17:16 +05:30
• 8bb43b9c9e Add benchmark dataset for mlperf llama tasks (#20338) Michael Goin 2025-07-15 04:10:07 +09:00
• 559756214b Change default model to Qwen3-0.6B (#20335) Tyler Michael Smith 2025-07-14 12:54:52 -04:00
• 6d0cf239c6 [CI/Build] Add Transformers nightly tests in CI (#20924) Isotr0py 2025-07-15 00:33:17 +08:00
• 3fc964433a [Misc] Clean up Aimv2 config registration in Ovis config (#20921) Isotr0py 2025-07-14 23:36:43 +08:00
• 0caf61c08a [CI] Update codeowner for compilation code (#20929) Lu Fang 2025-07-14 08:33:19 -07:00
• 667624659b [CI] cc folks on changes to vllm/compilation (#20925) Richard Zou 2025-07-14 10:52:17 -04:00
• 38efa28278 [Model] Add Ling implementation (#20680) ant-yy 2025-07-14 22:10:32 +08:00
• e8cc53af5e [Misc] Log the reason for falling back to FlexAttention (#20699) Cyrus Leung 2025-07-14 19:16:51 +08:00
• a4851cfe68 [Bugfix]: Fix messy code when using logprobs (#20910) Chauncey 2025-07-14 19:06:45 +08:00
• 9887e8ec50 [Misc] Remove unused function (#20909) Reid 2025-07-14 18:48:55 +08:00
• f326ab9c88 [Bugfix] Bump up mistral_common to support v13 tokenizer (#20905) 22quinn 2025-07-14 03:45:03 -07:00
• dcf2a5e208 [CI/Build] Fix OOM issue in Jina-VL test (#20907) Cyrus Leung 2025-07-14 18:32:35 +08:00
• 1e9438e0b0 [MISC] Move bind_kv_cache to worker module (#20900) wangxiyuan 2025-07-14 17:40:00 +08:00
• 697ef765ee [Refactor][V1] Move outlines utils for V1 imports (#20878) Aaron Pham 2025-07-14 03:58:35 -04:00
• a99b9f7dee [Quantization] add BNB for MixtralForCausalLM (#20893) Jee Jee Li 2025-07-14 15:34:34 +08:00
• c488b928a7 [ROCm] [Bugfix] [Critical]: Fix mamba compilation bug (#20883) TJianandvllmellm 2025-07-14 00:23:28 -07:00
• 2c7fa47161 Fix: Add missing EOFError handling in CLI complete command (#20896) Reid 2025-07-14 15:09:57 +08:00
• 88fc8a97e3 Removing redundant python version check (#20888) Daniel song 2025-07-14 02:15:05 -04:00
• 66f6fbd393 [Prefix Cache] Add reproducible prefix-cache block hashing using SHA-256 + CBOR (64bit) (#20511) Maroon Ayoub 2025-07-14 05:45:31 +03:00
• 8632e831ba [Core] Add update_config RPC method (#20095) 22quinn 2025-07-13 17:49:18 -07:00
• 4bbfc36b16 [V1] Hybrid allocator without prefix caching (#20661) nopperl 2025-07-14 01:55:14 +09:00
• 80d38b8ac8 [V1] [ROCm] [AITER] Upgrade AITER to commit 916bf3c and bugfix APIs (#20880) TJian 2025-07-13 08:19:32 -07:00
• 211b6a6113 [Bugfix] fix define of RerankDocument (#20877) Liuchenlongandliuchenlong 2025-07-13 22:32:40 +08:00
• 247102f07f [Bugfix] Fix: add patch_rope_scaling after hf override (#20857) Wang Siyuan 2025-07-13 15:13:25 +08:00
• bd4c1e6fdb Support for LlamaForSequenceClassification (#20807) Minkyu Kim 2025-07-13 16:09:34 +09:00
• 99b4f080d8 Renable google/gemma-3-1b-it accuracy test. (#20866) QiliangCui 2025-07-12 21:48:56 -07:00
• 020f58abcd [Core] Support multiple tasks per model (#20771) Nicolò LucchesiandDarkLight1337 2025-07-13 04:40:11 +02:00
• c1acd6d7d4 [Refactor] Change the way of import triton (#20774) Wentao Ye 2025-07-12 22:39:55 -04:00
• 3b3b778d4a [Bugfix] Fix a couple PPLX+CUTLASS MoE bugs (#20825) ElizaWszola 2025-07-13 04:39:14 +02:00
• 42d440c22b [Perf] Use Triton instead of Torch for DeepGEMM Per Token Group Quant (#20841) Wentao Ye 2025-07-12 22:38:45 -04:00
• f45a332886 [Sched] Enhance the logic to remove stopped requests from queues (#20739) Woosuk Kwon 2025-07-12 15:33:13 -07:00
• 6e2c176e1f [Bugfix] Restrict Machete to only run on Hopper (#20830) Michael Goin 2025-07-13 02:34:40 +09:00
• a86754a12b [docs] convert supported configs to table (#20858) Reid 2025-07-12 21:54:50 +08:00
• c2a2f19aba [Bugfix] Fix Tensor Parallelism Padding Consistency in Granite Models (#20843) Alex Brooks 2025-07-12 07:11:30 -06:00
• 2c11a738b3 [Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702) Congcong Chen 2025-07-12 06:02:10 -07:00
• b639327ad9 Revert "Use NVCC --compress-mode to reduce binary size by 30% #20694" (#20853) Michael Goin 2025-07-12 15:07:35 +09:00
• 4afe687a82 Enable ModelOpt Llama4 fp8 checkpoint deployment (#20419) Zhiyu 2025-07-11 23:07:16 -07:00
• 5de8d9f111 Remove extra tensor on CPU (#20693) Maximilien de Bayser 2025-07-12 03:06:34 -03:00