Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86

Mono Color

• f17aec0d63 [doc] Fold long code blocks to improve readability (#19926) Reidandreidliu41 2025-06-23 13:24:23 +08:00
• 493c275352 Fix(models/siglip): Add compatibility for Gemma models quantized by llm-compressor (#19643) Vensen 2025-06-23 11:40:28 +08:00
• f39ab2d4bd [Misc] Configurable timeout for execute_model RPC calls via env var (#19544) jinqinn 2025-06-23 11:36:26 +08:00
• 4a0f7888a3 [Core] feat: Implement Priority Scheduling in V1 Engine (#19057) amitandRoger Wang 2025-06-23 06:18:08 +03:00
• c4cf260677 [Perf][CLI] Improve overall startup time (#19941) Aaron Pham 2025-06-22 19:11:22 -04:00
• 33d51f599e [BugFix] Add an env to disable moe chunking to work around compile incompatibility (#19642) Ye (Charlotte) Qi 2025-06-22 15:17:49 -07:00
• e91386cde1 [Chore] dedup logs (#19955) Aaron Pham 2025-06-22 15:43:07 -04:00
• 2c11a29f0b [Misc] Simplify vllm bench cli subcommand implementation (#19948) Ye (Charlotte) Qi 2025-06-22 09:34:48 -07:00
• c76a506bd6 [Misc] Update model-specific PR tagging (#19949) Roger Wang 2025-06-22 05:16:08 -07:00
• ec0db6f51c [doc] use snippets for contact us (#19944) Reidandreidliu41 2025-06-22 18:26:13 +08:00
• c305a2109d [CI/Build] Auto tag perf benchmarks related PRs (#19943) 22quinn 2025-06-22 01:46:21 -07:00
• 202c5df935 [Benchmark] fix request loss if "ping" is returned (#19535) Wang, Yiandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2025-06-22 15:21:04 +08:00
• 2bb246b8f7 [MISC] add cpu_kvcache_space_bytes to CacheConfig (#19812) Ning Xie 2025-06-22 13:39:09 +08:00
• 4c409cabc2 [Misc] add vllm_config in __init__ (#19866) Ning Xie 2025-06-22 11:10:46 +08:00
• 3b1e4c6a23 [Docs] Add GPT2ForSequenceClassification to supported models in docs (#19932) Adrian 2025-06-21 22:57:19 +02:00
• 2c5302fadd [Multimodal] Optimize Qwen2/2.5-VL startup time (#19756) Woosuk KwonandRoger Wang 2025-06-21 13:01:07 -07:00
• caa680fd2e [doc] add contact us in community (#19922) Reidandreidliu41 2025-06-22 01:29:06 +08:00
• c3bf9bad11 [New model support]Support Tarsier2 (#19887) 汪志鹏 2025-06-21 12:01:51 +08:00
• 6f170f11dd [Bugfix] Fix bnb 8bit model weights loading (#19917) Isotr0py 2025-06-21 11:29:09 +08:00
• 8ca81bb069 Fix: Check the type of params to be a Sequence not list. (#19910) Rabin Adhikari 2025-06-21 01:03:17 +02:00
• e773a9e1c2 [Misc] Clean up useless code (#19889) wangxiyuan 2025-06-21 05:09:09 +08:00
• 71baf85ae1 [Kernel] mark TorchSDPABackend swap_blocks NotImplementedError (#19749) Ning Xie 2025-06-21 02:18:11 +08:00
• 79f2f1c2a1 [CPU][CI] Fallback sliding window to v0 and fix CPU pooling model tests (#19901) Li, Jiang 2025-06-20 23:30:36 +08:00
• 2e3e3c86dc Export NaNs in logits to scheduler_stats if output is corrupted (#18777) Vlad Tiberiu Mihailescu 2025-06-20 07:47:16 -07:00
• 7e8977fcd4 [custom_op][vllm-plugin] update custom_op class to use op_registry (#19164) Chendi.Xue 2025-06-20 09:44:56 -05:00
• f1e840e842 [Model] GPT2ForSequenceClassification model (#19663) Adrianandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2025-06-20 14:07:41 +02:00
• 7771d1de88 [Fix] import regex instead of re (#19875) Thomas Parnell 2025-06-20 13:16:48 +02:00
• 71d1219545 [Kernel] correct cpu worker function parameter type (#19745) Ning Xie 2025-06-20 18:50:13 +08:00
• e384f2f108 [Misc] refactor example - openai_transcription_client (#19851) Reidandreidliu41 2025-06-20 16:02:21 +08:00
• 089a306f19 [Misc] update cuda version (#19526) Reidandreidliu41 2025-06-20 15:25:15 +08:00
• 5e666f72cd [Bugfix][Ray] Set the cuda context eagerly in the ray worker (#19583) kourosh hakhamaneshi 2025-06-19 22:01:16 -07:00
• e3a3e4db46 [Bugfix] Enable PP with AITER+V1 (#19822) qli88 2025-06-19 23:43:20 -05:00
• e41bf15cd0 [Chore]: qwen3-moe-type-hints-mistake (#19860) Xerxesandxinnan.hou 2025-06-20 12:43:07 +08:00
• 5aa4a015ce [Benchmark] Fix Value of type "SampleRequest" is not indexable (#18032) Brayden Zhong 2025-06-20 00:28:55 -04:00
• b6bad3d186 [CI][Neuron] Fail and exit on first error (#19622) Elaine Zhaoandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2025-06-19 21:27:51 -07:00
• ee9a1531aa [CI/Build][Bugfix] Fix deadlock on v1 engine test CI (#19872) Isotr0py 2025-06-20 09:51:07 +08:00
• 10d82f9ac5 [Benchmark][Bugfix] Fix Dataset Length Calculation (#19868) Robert ShawandRobert Shaw 2025-06-19 21:30:41 -04:00
• ea10dd9d9e [Frontend] early return chat format resolution when specified (#19735) xzbdmw 2025-06-20 02:49:59 +08:00
• ead2110297 [Core][Bugfix] Fix Online MM Beam Search (#19688) Alex Brooks 2025-06-19 11:18:07 -06:00
• 01220ce89a [CI][CPU] Improve dummy Triton interfaces and fix the CPU CI (#19838) Li, Jiang 2025-06-19 23:46:09 +08:00
• 6f68c49220 [Doc] Update V1 user guide for embedding models (#19842) 22quinn 2025-06-19 02:43:27 -07:00
• 4719460644 Fixing Chunked Prefill Test. (#19762) Alexei-V-Ivanov-AMD 2025-06-19 03:36:16 -05:00
• 466166dcfd [Frontend] Add optional token-level progress bar to LLM.beam_search (#19301) NekoMimiUnagiand22quinn 2025-06-19 02:21:41 -05:00
• 1d0ae26c85 Add xLAM tool parser support (#17148) Zuxin 2025-06-18 23:26:41 -07:00
• 6021999573 [Minor] Allow redirecting model path for HfRunner in test (#19795) Isotr0py 2025-06-19 14:04:10 +08:00
• c7b370c603 raise exception for pin_lora (#19809) Ning Xie 2025-06-19 13:57:35 +08:00
• aa20d10a91 [Misc] [ROCm] Prevent surplus tensor reshape (#19803) zsolt-borbely-htec 2025-06-19 07:57:16 +02:00
• 2de12be428 [ROCm] [AITER] [Bugfix] Patch for AITER commit 648764942e552a8bb5fe16026703716a81f05374 (#18990) TJian 2025-06-18 22:56:31 -07:00
• 83ca9ae47b Mark invariant normalizer in Gemma as non-persistent (#19788) Yu-Hang "Maxin" Tang 2025-06-18 22:56:03 -07:00
• e2148dc5ea [Bugfix] Add check_health to v1 async client. (#19821) kourosh hakhamaneshi 2025-06-18 21:47:01 -07:00
• b1098b4072 [Bugfix] Fix the linter (#19826) Lu Fang 2025-06-19 12:44:41 +08:00
• 799397ee4f Support embedding models in V1 (#16188) Maximilien de Bayserand22quinn 2025-06-19 01:36:33 -03:00
• 4959915089 [Quantization] Modify the logic of BNB double quantization (#19742) Jee Jee Li 2025-06-19 11:52:09 +08:00
• 8d1e89d946 [Misc][ROCm] Enforce no unused variable in ROCm C++ files (#19796) Lu Fang 2025-06-19 11:25:15 +08:00
• 36239f79dd Fix FA2 fallback for Blackwell V1 (#19781) Michael Goin 2025-06-19 10:53:55 +09:00
• dfada85eee [Frontend] Expose custom args in OpenAI APIs (#16862) afeldman-nmandNick Hill 2025-06-18 20:41:11 -04:00
• ed33349738 [BugFix] Fix use_cudagraph=False (#19612) Richard Zou 2025-06-18 20:23:12 -04:00
• d49adea1f9 [Multimodal] Use fast processor for Qwen2/2.5-VL (#19789) Woosuk Kwon 2025-06-18 15:49:40 -07:00
• 14fdd21d39 [Core] More fixes to MultiModalEmbeddings type handling (#19715) Russell Bryant 2025-06-18 18:48:29 -04:00
• 04fefe7c9a [TPU] Update torch-xla version to include paged attention tuned block change (#19813) QiliangCui 2025-06-18 15:41:13 -07:00
• 3b523e38d9 [Core] Do not copy array during hashing (#19484) Lukas Geiger 2025-06-18 23:36:55 +01:00
• 16c16301c8 Disable "Forbid direct 'import triton'" check for vllm/triton_utils/importing.py in an extensible way (#19783) afeldman-nm 2025-06-18 18:08:00 -04:00
• 9206d0ff01 docs: fix Slack bulletpoint in README (#19811) Nathan Weinberg 2025-06-18 16:47:08 -04:00
• a89209b78d [v1] Support mamba2 (#19327) Chen Zhang 2025-06-19 04:34:15 +08:00
• ffacb222cb [Docs] Add Huzaifa Sidhpurwala to vuln mgmt team doc (#19808) Russell Bryant 2025-06-18 16:22:28 -04:00
• 12575cfa7a [Bugfix] fix RAY_CGRAPH_get_timeout is not set successfully (#19725) Chauncey 2025-06-19 01:26:16 +08:00
• 8b6e1d639c [Hardware][AMD] integrate aiter chunked prefill into vllm (#18596) 3 people 2025-06-18 23:46:51 +08:00
• 735a9de71f [Qwen] Add tagging rule for Qwen related PRs (#19799) Lu Fang 2025-06-18 22:26:43 +08:00
• 257ab95439 [Platform] Allow platform use V1 Engine by default (#19792) wangxiyuan 2025-06-18 21:03:36 +08:00
• cca91a7a10 [doc] fix the incorrect label (#19787) Reidandreidliu41 2025-06-18 18:30:58 +08:00
• f04d604567 [Minor] Zero-initialize attn output buffer (#19784) Woosuk Kwon 2025-06-17 23:59:27 -07:00
• 19a53b2783 [V1] Decouple GPU and TPU InputBatch (#19778) afeldman-nm 2025-06-18 02:38:13 -04:00
• eccdc8318c [V1][P/D] An native implementation of xPyD based on P2P NCCL (#18242) Zhonghua Deng 2025-06-18 14:32:36 +08:00
• 5f52a84685 [V1] Add API docs for EncoderCacheManager (#19294) Russell Bryant 2025-06-18 01:37:01 -04:00
• d4629dc43f [Misc] Add __str__ for RequestStatus (#19780) lkchen 2025-06-17 20:03:01 -07:00
• 6e9cc73f67 [MISC] correct DeviceConfig device field static type analysis (#19699) Ning Xie 2025-06-18 08:21:50 +08:00
• c53711bd63 [MISC] correct copy_blocks src_to_dists param type (#19696) Ning Xie 2025-06-18 08:21:06 +08:00
• dac8cc49f4 [TPU] Update torch version to include paged attention kernel change (#19706) Chenyaaang 2025-06-17 15:24:49 -07:00
• a44b1c951d [Feature][ROCm] Add full graph capture support for TritonAttentionBackend (#19158) Charlie Fu 2025-06-17 16:03:06 -05:00
• b447624ee3 [Bugfix] Fix faulty triton importing logic when using Ray for DP (#19734) Michael Goin 2025-06-18 05:59:29 +09:00
• cda92307c1 [Misc] Update lmcache connector with the latest connector apis (#19441) Jiayi Yao 2025-06-17 12:57:54 -07:00
• bf57ccc5c2 Remove sm120 arch from sm100 cutlass kernel arch list (#19716) Michael Goin 2025-06-18 03:49:39 +09:00
• ffb2cd6b54 [Perf] Optimize moe_align_block_size CUDA kernel (#19572) Wentao Yeandmgoin 2025-06-17 14:49:26 -04:00
• ca94d7fa00 [Bugfix] Update multimodel models mapping to fit new checkpoint after Transformers v4.52 (#19151) Isotr0py 2025-06-17 23:58:38 +08:00
• 5a1c2e15d8 [Mis] remove duplicate engine status checks (#19647) CYJiang 2025-06-17 23:17:38 +08:00
• 4c8f64faa7 [V1][Kernel] Flashinfer HND KV cache layout (#19280) Nicolò Lucchesi 2025-06-17 15:09:22 +02:00
• 93aee29fdb [doc] split "Other AI Accelerators" tabs (#19708) David Xia 2025-06-17 09:05:29 -04:00
• 154d063b9f [doc][mkdocs] Add edit button to documentation (#19637) Reidandreidliu41 2025-06-17 19:10:31 +08:00
• ccd7c05089 [Kernel] Add Split-KV Support to Unified Triton Attention Kernel (#19152) jvlunteren 2025-06-17 12:45:07 +02:00
• c48c6c4008 Add a doc on how to update PyTorch version (#19705) Huy Do 2025-06-17 03:10:37 -07:00
• aed8468642 [Doc] Add missing llava family multi-image examples (#19698) Isotr0py 2025-06-17 15:05:21 +08:00
• 5c76b9cdaf [Core] add remove_seq_from_computed_blocks_tracker to BlockSpaceManager (#19686) quanliuand刘全 2025-06-17 12:40:58 +08:00
• ddfed314f9 Fixes IMA for TP w/ flex-attention (#19712) Driss Guessous 2025-06-16 21:01:50 -07:00
• 5b3ad5ecf2 [DOC] fix doc typos (#19600) Di Liu 2025-06-17 11:34:53 +08:00
• ede5c4ebdf [Frontend] add chunking audio for > 30s audio (#19597) nguyenhoangthuan99 2025-06-17 10:34:00 +07:00
• 07334959d8 [Wheel Size] Only build FA2 8.0+PTX (#19336) Lucas Wilkinson 2025-06-16 23:32:49 -04:00
• 119f683949 [doc] add project flag to gcloud TPU command (#19664) David Xia 2025-06-16 21:00:09 -04:00
• 0860087aff [Fix] Fall back to Gloo when NCCL backend is unavailable (#19641) Conroy Cheers 2025-06-17 10:42:14 +10:00
• 6bc7b57315 [Quantization] Remove FP4 emulation; Fall-back to marlin for device < 100 (#19563) Dipika Sikka 2025-06-16 17:33:51 -04:00
• 90f9c2eb5c [V1] Change return type on get_multimodal_embeddings() (#19446) Russell Bryant 2025-06-16 13:32:15 -04:00