Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86

Mono Color

• c870eb9e0f [LoRA] Update LoRA expand kernel block_n calculation (#32621) Xin Yang 2026-02-23 23:17:53 -08:00
• 6af03f2394 [Refactor] [1/N] Reorganize kernel abstraction directory (#34055) 3 people 2026-02-24 14:47:22 +08:00
• 1a6cf39dec [CI/Build] Remove redundant OpenTelemetry pip install from CI configs (#35032) Vlad Tiberiu Mihailescu 2026-02-24 00:24:11 -06:00
• f91808ae0d [MM] Allow audio chunking for offline LLM (#34628) Nicolò Lucchesi 2026-02-24 06:04:28 +01:00
• 33a0d43c71 [BUGFIX][Qwen3.5] Hardcode mlp.gate as not quantizable (#35156) Vadim Gimpelson 2026-02-24 07:42:24 +04:00
• 80d93fd6da gpu_model_runner: Cache is_encoder_decoder from model config (#35099) pschlan-amd 2026-02-24 04:08:34 +01:00
• ec85340531 [Quantization] Support FP8 MoE bias for models like GPT-OSS (#34906) Jia GuoandClaude Opus 4.6 2026-02-23 19:07:47 -08:00
• 2ff4e51152 [ROCm] AITER fused RoPE+KVCache (#33443) 4 people 2026-02-23 21:06:00 -06:00
• 95642441d0 [Mamba1] - Change supports_update_block_table to True (#35054) Asaf Gardin 2026-02-24 05:05:57 +02:00
• a7c9f7b7ec [Bugfix] Fix lora_ids in FusedMoE LoRA test (#35135) Xin Yang 2026-02-23 18:49:25 -08:00
• a4bd661fb3 [Perf] Enable FlashInfer DeepGEMM swapAB on SM90 by default (#34924) Michael GoinandRobert Shaw 2026-02-23 20:34:41 -05:00
• 3ef9fd0f98 [Bugfix] Fix DSV3 kernels breaking _C and _moe_C on unsupported arches (#35123) Michael Goin 2026-02-23 20:11:27 -05:00
• 22a97e6613 [Perf] Improve default triton fused moe configs (#34846) Michael GoinandRobert Shaw 2026-02-23 19:01:28 -05:00
• 596ed1f02e [RL] Validation for pause_mode='keep' (#34992) Aaron Hao 2026-02-23 13:30:56 -08:00
• b8d8b7e934 [Misc] Monitor interface changes (#35113) Nicolò Lucchesi 2026-02-23 18:14:51 +01:00
• 28c5e69ba0 Enforce that model is the first positional arg when --served-model-name is used (#34973) Harry Mellor 2026-02-23 16:38:05 +00:00
• 864167d376 Fix custom processors that use deleted import for Transformers v5 (#35101) Harry Mellor 2026-02-23 16:38:00 +00:00
• a2ba6a5244 [Bugfix] Fix prefix caching for Mamba 'all' mode (Nemotron models) (#34874) haosdent 2026-02-24 00:31:51 +08:00
• c4f38696f7 Use Xet high performance mode for Transformers v5 (#35098) Harry Mellor 2026-02-23 16:19:30 +00:00
• a7f341c323 [Bugfix] Fix MRotaryEmbedding missing truncate attr with YaRN scaling (#35080) haosdent 2026-02-24 00:05:52 +08:00
• d13ece38d7 [CI] Skip Responses API (#34990) Robert ShawandRobert Shaw 2026-02-23 10:46:45 -05:00
• 5cc7c4452e [Metrics] Add Prometheus counters for Model FLOPs Utilization (MFU) (#30950) Mark McLoughlinandHarry Mellor 2026-02-23 15:01:07 +00:00
• b95bb6927f [kv-cache, ct] Use compressed-tensors as a source of ground-truth for quant strategies (#34254) Eldar KurtićandYour Name 2026-02-23 15:37:55 +01:00
• 392645454b [Refactor] Decouple TimingContext from InputProcessingContext (#35083) Cyrus Leung 2026-02-23 22:15:50 +08:00
• 1e8438a89a [Llama4,CI] Bring back Llama-4 bug fixes, and also fix Maverick tests (#35033) Eldar KurtićandEldar Kurtic 2026-02-23 15:04:34 +01:00
• 8435b2e049 [ModelBash][DSV3] Add TRTLLM DSV3 Router GEMM kernel (6% B1 Speedup) (#34302) Robert ShawandRobert Shaw 2026-02-23 09:02:26 -05:00
• b1b5e045df [XPU] allow TORCH_SDPA/TRITON_ATTN as XPU vit Backend (#35010) Yan Ma 2026-02-23 21:06:44 +08:00
• 5f68464f92 [ROCm][CI] Fix spec decode profile assertion and logprob test determinism (#35043) Andreas Karatzas 2026-02-23 07:05:54 -06:00
• aa08a30fc9 [CLEANING] Remove unused disable_by_batch_size from SpeculativeConfig (#35060) Vincent Gimenes 2026-02-23 14:05:36 +01:00
• 7f40e9e516 [Refactor] Remove dead private func _fp8_perm and _extract_mask_for_item (#35068) Wentao Ye 2026-02-23 08:05:20 -05:00
• 103e614b14 Fix pipeline parallel with embed scaling in the Transformers modelling backend (#35094) Harry Mellor 2026-02-23 13:04:47 +00:00
• 54e2f83d0a [Feature] Lazy import for the "mistral" tokenizer module. (#34651) Neil Schemenauer 2026-02-23 00:43:01 -08:00
• e631f8e78e fix: Apply embedding_multiplier to inputs_embeds (#34813) 3 people 2026-02-23 01:42:46 -07:00
• e97c46a92d [BugFix]: Fix local mypy issues (#34739) Martin HickeyandHarry Mellor 2026-02-23 08:40:29 +00:00
• 7291d1b288 [Bugfix] Fix kernel benchmark (#33752) Jee Jee Li 2026-02-23 13:18:08 +08:00
• 987506bca6 [Refactor] Simplify dummy data generation (#35025) Cyrus Leung 2026-02-23 12:55:27 +08:00
• c645e9a214 [Model Runner V2] Remove propose_draft method (#35070) Woosuk Kwon 2026-02-22 18:27:12 -08:00
• 944ffb5968 [Model Runner V2][Minor] Remove redundant do_spec_decode field (#35039) Nick HillandWoosuk Kwon 2026-02-22 16:18:04 -08:00
• 2bcf71b9c0 [Spec Decode] Reduce TP communication for speculative decoding draft token generation (#34049) qizixiandLu Fang 2026-02-22 14:59:16 -08:00
• b7892a3bef [Model] Add NVFP4 quantization support for Step3.5-Flash (#34478) 3 people 2026-02-22 14:30:46 -05:00
• 682566b18e [Bug] Refactor max_num_batched_tokens to account for drafting (#34898) Benjamin Chislett 2026-02-22 11:18:46 -05:00
• b9c2a565cc [Spec Decode] Defer clearing KV connector metadata for EAGLE3 speculative decode + prefill / decode disagg setup (#34529) qizixiandLu Fang 2026-02-22 08:08:32 -08:00
• dd8c3a7fb2 [ROCm][CI] Fix realtime test timeouts caused by aiter JIT compilation delays (#35052) Andreas Karatzas 2026-02-22 04:07:18 -06:00
• a8a47c17b6 [ROCm][CI] Fix flaky embedding chat test by using tolerance-based comparison (#35050) Andreas Karatzas 2026-02-22 03:03:44 -06:00
• 40f88d8318 [Bugfix] Fix Qwen3/Qwen3.5 Reasoning Parser (#34779) Roger Wang 2026-02-21 23:15:35 -08:00
• 2cbf9656ce [Model Runner V2] Enable CUDA graph for Eagle3 (#35040) Woosuk Kwon 2026-02-21 21:42:50 -08:00
• 30132cd144 Fix apply_top_k_top_p_triton called by non-cuda logits Tensor (#35030) Xiao Li 2026-02-21 21:11:54 -08:00
• cbd95a2dd1 [Benchmark] Use sns.relplot for plotting (#35027) Cyrus Leung 2026-02-22 12:26:48 +08:00
• 970861ac0c [New Model] Add ColModernVBERT (#34558) Athrael Soju 2026-02-22 04:23:41 +00:00
• d24bdd7c4b [CI] Bump mteb version to mteb[bm25s]>=2, <3 for pooling model unit tests (#34961) Wentao Ye 2026-02-21 23:23:24 -05:00
• d403c1da1c [CI] Stabilizing ROCm amd-ci signal and minor name fix in upstream (#35008) Andreas Karatzas 2026-02-21 22:01:10 -06:00
• b71fbd06e2 [Model Runner V2] Support attention group (#35036) Woosuk Kwon 2026-02-21 16:42:53 -08:00
• 74d90b1ce4 [Model Bash][DSR1] Add selective dynamic shape marking for CustomOp (#34900) Vadim Gimpelson 2026-02-22 04:28:01 +04:00
• a4047d4ea9 [Model Runner V2] Support Eagle3 (no CUDA graph) (#35029) Woosuk Kwon 2026-02-21 12:55:24 -08:00
• 965fe45935 [CI/Build] Fix gRPC version mismatch (#35013) Cyrus Leung 2026-02-22 03:14:41 +08:00
• 98b0205c3c [Frontend] Add automatic language detection for Whisper transcription (#34342) 3 people 2026-02-21 13:49:41 +01:00
• 272b535ab3 [Bugfix] Gate 256-bit instructions to CUDA 12.9+ (#34791) Huy DoandCyrus Leung 2026-02-21 04:48:14 -08:00
• f74f1572ca [Benchmark] Improve benchmarks (#35012) Cyrus Leung 2026-02-21 18:31:58 +08:00
• bebfe55b1c [Doc] Fix example of eagle3 (#34960) petrpechmanandPetr Pechman 2026-02-21 10:57:53 +01:00
• 820d7815eb [Core] Minor structured-output related scheduler optimization (#34765) Nick HillandCyrus Leung 2026-02-21 01:38:28 -08:00
• ab6f3487a6 [PD] Change kv_load_failure_policy Default from "recompute" to "fail" (#34896) Nicolò LucchesiandCyrus Leung 2026-02-21 10:34:57 +01:00
• 8dc8a99b56 [ROCm] Enable bitsandbytes quantization support on ROCm (#34688) BADAOUI Abdennacer 2026-02-21 09:34:55 +01:00
• 2aab2bb543 [ROCM] Optimize ROCM_AITER_FA spec decode eagle performance (#34541) jennyyyyzhen 2026-02-20 20:32:05 -08:00
• 54254f7a61 [ROCm][CI] Fix spec decode logprobs flakiness and parametrize tree attention backends (#34599) Andreas Karatzas 2026-02-20 22:25:23 -06:00
• cf93c1a128 [ROCm][AITER] Fix aiter paged_attention_v1 decode for sliding window and head_size < 64 (#34570) Andreas Karatzas 2026-02-20 22:25:07 -06:00
• 89358f0d35 [CI] Fix ColBERT HF comparison tests on AMD CI + refactor (#34567) Andreas Karatzas 2026-02-20 22:12:05 -06:00
• a0fe7ea2f0 [feat] Add per-block extra_keys to KV events (#33304) 3 people 2026-02-20 21:11:40 -07:00
• 991d6bff38 [CI][MCP][Harmony] Heavy refactoring Harmony & MCP response tests and stabilizing with deterministic test infrastructure (#33949) Andreas Karatzas 2026-02-20 22:03:32 -06:00
• 5719a4e4e6 [Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) + NewModel: nvidia/nemotron-colembed (#34574) Kata Coder 2026-02-21 13:01:40 +09:00
• 11be2c74dc [Realtime] Add Qwen3-ASR realtime streaming support (#34613) 4 people 2026-02-20 19:59:42 -08:00
• 7a5adad480 [Kernel] Optimize sample_recovered_tokens_kernel (#34974) Xin Yang 2026-02-20 19:59:06 -08:00
• 59c6233297 Support prompt_embeds for pooling requests in output processor (#34904) LiandLi Zhang 2026-02-20 22:57:38 -05:00
• d38cd3dde5 [Misc] Fix mypy errors in vllm/profiler and remove from exclude list (#34959) Taneem Ibrahim 2026-02-20 21:56:33 -06:00
• ded333fb9b [ROCm][Bugfix]: Only save unpadded sizes for shared_experts in MoERunner to fix rmsnorm pad fusion (#34636) Rohan Potdar 2026-02-20 21:56:16 -06:00
• 9d7577b2bd [Kernel] [Helion] [9/N] Canonicalize GPU variant names to base model names (#34928) Yanan CaoandClaude Opus 4.6 2026-02-20 19:55:51 -08:00
• e739c29ea4 [CI/Build] Add opentelemetry libs in default vllm build (requirements/common.txt) (#34466) Vlad Tiberiu Mihailescu 2026-02-20 19:54:55 -08:00
• a55caf6ae9 [LoRA] Support Quantized Adapters (#30286) 7 people 2026-02-20 19:54:35 -08:00
• 0e22cd618b Revert "[Llama4,Quantization] Simplify and generalize logic for Q/K permutations in quantized self-attn layers " (#34997) Lucas Wilkinson 2026-02-20 20:19:19 -05:00
• ea5f903f80 Bump Flashinfer Version and Re-enable DeepSeek NVFP4 AR+Norm Fusion (#34899) Wei ZhaoandCyrus Leung 2026-02-20 16:37:31 -05:00
• 0632ed8778 [AMD][CI] Fix test_custom_allreduce for A100 testgroup (#34735) Ryan Rock 2026-02-20 15:33:04 -06:00
• aaefc58ee0 [CI] Revert PRs 34818 and 33600 (#34979) Lucas Wilkinson 2026-02-20 16:25:50 -05:00
• f24b2de3d3 [Test] Add FP8 KV Cache Testing for MLA Backends (#34473) Wei Zhao 2026-02-20 13:51:58 -05:00
• fac1507f03 [CI] Remove failing prime-rl integration test (#34843) Michael Goin 2026-02-20 13:17:42 -05:00
• f863994084 [compile] Fix torch.compile time discrepancy in logging. (#34912) Zhengxu ChenandCyrus Leung 2026-02-20 11:47:14 -05:00
• e4a5d8c653 [compile] Move torch_aot_compile directory under torch_compile_cache (#34831) Zhengxu Chen 2026-02-20 11:46:45 -05:00
• a6d0299c75 [Kernel] [Helion] [6/N] Add num_tokens dimension to silu_mul autotuning and dispatching (#34185) Yanan Cao 2026-02-20 08:36:51 -08:00
• 6ce80f7071 Ensure that MkDocs v2 does not get installed (#34958) Harry Mellor 2026-02-20 15:38:11 +00:00
• 1fe462168c [perf] Avoid dtype promotion sync in mamba_get_block_table_tensor (#34870) Huamin LiandCyrus Leung 2026-02-20 06:21:56 -08:00
• ed31a020ee [Refactor] Extract Harmony streaming SSE event builders into streaming_events.py (#34909) Flora FengandCyrus Leung 2026-02-20 09:20:46 -05:00
• f9ac19204f [V0 Deprecation] Remove unused MM placeholders in request output (#34944) Cyrus Leung 2026-02-20 22:19:23 +08:00
• 59965affbd [BUGFIX] Fix _dummy_run missing prepare_inputs_event synchronization (#34866) Vadim Gimpelson 2026-02-20 17:54:27 +04:00
• b1c4f0b265 [Kernel] Optimize grouped topk kernel (#34206) Xin Yang 2026-02-20 01:34:45 -08:00
• 8de7c636cc [Bugfix][Hardware][AMD] Fix ROCM_AITER_FA speculative decoding support (#32877) Kevin McKayandLu Fang 2026-02-20 00:25:46 -06:00
• 059779231f [Minor] Add logging when using MXFP4 MXFP8 TRTLLM backend (#34916) Frank WangandWentao Ye 2026-02-19 22:07:57 -08:00
• ea37530b47 [Models] LFM2: Support LoRA (#34921) 3 people 2026-02-19 22:07:23 -08:00
• f5432e35a3 [ROCm][CI] Loosen RemoteOpenAIServer Startup Timeout (#34922) Micah Williamson 2026-02-19 23:37:49 -06:00
• 07cab212f0 [Misc] Add deprecated environment variable utilities (#33677) 3 people 2026-02-20 13:33:25 +08:00
• 0c1dc42748 [CI][AMD][BugFix][P/D] Add default_vllm_config to test_moriio_connector.py so tests pass (#33739) rasmith 2026-02-19 23:32:40 -06:00
• 676f82ae81 Add validation to reject non-text content in system messages (#34072) Varun Chawla 2026-02-19 21:30:33 -08:00
• 81bfc21a6a [Model Bash]: Improve FP8 Oracle for Config Specific Kernel Selection (#34260) 3 people 2026-02-19 23:29:08 -06:00