Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86

Mono Color

• ac0675ff6b [CI] Allow Deprecated Quantization For LM Eval Tests (#32065) Micah Williamson 2026-01-09 20:10:47 -06:00
• e18464a57d [Perf] Optimize async scheduling placeholder using empty (#32056) Wentao Ye 2026-01-09 19:46:11 -05:00
• 1963245ed1 [Core] Use weights_only=True with torch.load (#32045) Russell Bryant 2026-01-09 19:28:57 -05:00
• 0308901975 [2/N][Attention] Fix pre-commit errors (#32052) Matthew Bonanni 2026-01-09 19:27:15 -05:00
• aaf4b70aae [Misc][BE] Type coverage for vllm/compilation [2/3] (#31744) Lucas Kabela 2026-01-09 15:30:38 -08:00
• 3adffd5b90 [Misc] Enable async scheduling by default with spec decoding (#31998) Nick Hill 2026-01-09 15:09:34 -08:00
• 97ba96fbe9 [perf][async] support non cpu sync get logprob tensors for spec (#31336) zhrrr 2026-01-10 05:24:51 +08:00
• 94578127a4 [NIXL] refine decoder side post process for heterogeneous BlockSize and kv_layout (#30275) Chendi.Xue 2026-01-09 15:22:19 -06:00
• 2612ba9285 [1/N][Attention] Restructure attention: move files (#31916) Matthew Bonanni 2026-01-09 16:10:24 -05:00
• 1f8b7c536b [responsesAPI] fix incomplete_messages for simple/parsable context (#31836) Andrew XiaandAndrew Xia 2026-01-09 16:00:57 -05:00
• 0a0aa07747 [Quant] Make static quant support all group shapes (#30833) Lucas Wilkinson 2026-01-09 15:49:27 -05:00
• f9e2a75a1e [fix] add cutedsl to global sf (#32001) jiahanc 2026-01-09 12:03:02 -08:00
• a4d5d663e2 Add unpermute-aware fused MoE path and small-batch fallback (#29354) Runkai TaoandJee Jee Li 2026-01-09 14:58:39 -05:00
• 657e9c0e18 [Fix] Introduce audio channels spec (#31595) Jeremy Teboul 2026-01-09 11:34:51 -08:00
• 308feab33f [Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput improvement, 2.2% TTFT improvement (#31830) Wentao YeandLuka Govedič 2026-01-09 14:13:43 -05:00
• 28ae32a5d3 [Refactor] Remove numpy split in async scheduling (#32034) Wentao Ye 2026-01-09 14:09:02 -05:00
• f32c629eb4 [Frontend][gpt-oss] Allow system message to overwrite model identity (#31737) 4 people 2026-01-09 14:03:57 -05:00
• cd4a95e3aa [Feat][Core] Support multiple KV cache groups in Hybrid KV Coordinator (#31707) Yifan Qiao 2026-01-09 10:53:20 -08:00
• d5ec6c056f [UX] Add vLLM model inspection view (#29450) Michael Goin 2026-01-09 12:12:35 -05:00
• 08d954f036 [Doc] Add developer guide for CustomOp (#30886) Shanshan Shen 2026-01-10 00:21:11 +08:00
• ac9f9330e6 Rename --exclude-log-deltas to --enable-log-deltas (#32020) Kevin Šuc 2026-01-09 16:30:40 +01:00
• 2d0c5b630e [Doc] Remove hardcoded Whisper in example openai translation client (#32027) Isotr0py 2026-01-09 22:44:52 +08:00
• 34cd32fe30 [Perf][Kernel] Fused SiLU+Mul+Quant kernel for NVFP4 cutlass_moe (#31832) Michael Goin 2026-01-09 09:40:33 -05:00
• 8e27663b6a [CPU] Add head sizes 80 and 112 with vec16 fallback (#31968) R3hankhan 2026-01-09 19:44:46 +05:30
• 7cdf7e2fe0 [Model] Remove redundant None check in DeepSeekOCR image input processing (#32016) maang 2026-01-09 22:12:44 +08:00
• bbf80ede43 Fix type error (#31999) Adolfo VictoriaandAdolfo Victoria 2026-01-09 06:03:32 -08:00
• 4505849b30 [ROCm][PD] add moriio kv connector. (#29304) inkcherry 2026-01-09 22:01:57 +08:00
• db07433ce5 [Misc] Skip hashing kwargs if value is None (#32025) Roger Wang 2026-01-09 05:20:59 -08:00
• e02706d2d2 [ROCm][CI][V1] Fix nixl_connector test failure and achieve CUDA parity in test_async_scheduling (#32000) Andreas Karatzas 2026-01-09 06:48:32 -06:00
• b474782ad7 [Feature][Benchmarks] Custom dataset: read output length from dataset (#31881) Sophie du Couédic 2026-01-09 13:40:59 +01:00
• 55212c1404 fix: remove duplicate engine_id check in nixl_connector (#31948) Bofeng XueandBofeng BF1 Xue 2026-01-09 20:13:17 +08:00
• e7b68f4d6c [Bugfix] Fix Triton FusedMoE LoRA (#30585) Xin Yang 2026-01-09 03:46:59 -08:00
• 1a19e9cd87 [Bugfix][ROCm]Fix Qwen3-Next-80B-A3B-Thinking inference and optimize non-standard block size (544) support under rocm_atten (#31380) vllmellm 2026-01-09 12:28:02 +01:00
• c8ed39b9dd [Model] Reorganize pooling layers (#31973) Cyrus Leung 2026-01-09 19:02:14 +08:00
• 020732800c [Bugfix] Fix OpenAPI schema test failures (#31921) Andreas Karatzas 2026-01-09 04:56:20 -06:00
• dc77cb7129 [Bugfix] Fix Var Length Batched Padding in Granite Speech (#31906) Alex Brooks 2026-01-09 03:28:43 -07:00
• bde38c11df fix lora moe sharding when rank < max_lora_rank (#31994) gnovackandJee Jee Li 2026-01-08 22:43:25 -08:00
• 707b240d7e [Bugfix] Fix FusedMoE LoRA w2_output_size (#31949) Xin Yang 2026-01-08 21:54:05 -08:00
• 29ce48221c [Cleanup] Remove obsolete spec decoding compatibility logic (#32003) Nick Hill 2026-01-08 21:44:18 -08:00
• 7a05d2dc65 [CI] [ROCm] Fix tests/entrypoints/test_grpc_server.py on ROCm (#31970) TJian 2026-01-09 12:54:20 +08:00
• a1648c4045 [ROCm][CI] Fix test_token_classification.py::test_bert_models (#31993) Divakar Verma 2026-01-08 22:04:33 -06:00
• e2d49ec2a4 [Bugfix] missing tokens occur in harmony streaming (#30437) RioSandChauncey 2026-01-09 12:59:34 +09:00
• 8413868dab [Bugfix] Fix typo in FusedMoE LoRA reshape comment (#31992) Xin Yang 2026-01-08 18:46:05 -08:00
• 8ff4a99566 [Async][Feat] support apply penalty or bad_words for async + spec (#30495) zhrrrandNick Hill 2026-01-09 10:31:50 +08:00
• a4ec0c5595 [Frontend] Add MCP tool streaming support to Responses API (#31761) daniel-salib 2026-01-08 17:19:34 -08:00
• 0fa8dd24d2 [Bugfix] Fix Typo from NVFP4 Refactor (#31977) Robert ShawandRobert Shaw 2026-01-08 19:18:50 -05:00
• 6ebe34d6fa [Feature] Add iteration level logging and enhance nvtx marker (#31193) Max HuandMax Hu 2026-01-08 19:13:39 -05:00
• 11cec296dd [BugFix] Add spec-decode-incompatible request param validation (#31982) Nick Hill 2026-01-08 16:08:21 -08:00
• 5825bbc1f7 [Quantization] Deprecate Long Tail of Schemes (#31688) 3 people 2026-01-08 19:07:45 -05:00
• d62cfe546d [MoE Refactoring][Bugfix]Wrap WNA16 Triton kernel into mk and change compressed tensor kernel selection (#31752) Yongye ZhuandRobert Shaw 2026-01-08 16:01:30 -08:00
• 6cdf015c3c [Misc] Fix Current vLLM config is not set. warnings, assert to avoid issues in the future (#31747) Lucas WilkinsonandLuka Govedič 2026-01-08 18:20:49 -05:00
• 5d3b6097ad [Compressed-Tensors] Simplify NVFP4 Conditions, enable marlin support for NVFP4A16 MoEs (#30881) Dipika Sikka 2026-01-08 17:45:17 -05:00
• e74698c27a [Misc][Refactor] Add FusedMoERouter object (#30519) bnellnm 2026-01-08 15:52:55 -05:00
• aa125ecf0e [Frontend] Improve error message (#31987) Cyrus Leung 2026-01-09 04:07:03 +08:00
• f16bfbe5bc [Documentation][torch.compile] Add documentation for torch.compile + multimodal encoders (#31627) Lucas Kabela 2026-01-08 11:33:24 -08:00
• 87e07a6b46 Revert "feat(moe): Add is_act_and_mul=False support for Triton MoE kernels" (#31978) Michael Goin 2026-01-08 14:31:53 -05:00
• 7508243249 [Model Runner V2] Simplify BlockTables with UVA (#31965) Woosuk Kwon 2026-01-08 10:24:26 -08:00
• 83e1c76dbe [CI][ROCm] Fix NIXL tests on ROCm (#31728) Nicolò Lucchesi 2026-01-08 18:34:43 +01:00
• a563866b48 Fix ijson build for Power. (#31702) Nishidha Panpaliya 2026-01-08 22:42:33 +05:30
• a3d909ad2b [Misc] Tidy up some spec decode logic in GPUModelRunner (#31591) Nick Hill 2026-01-08 09:10:07 -08:00
• 49568d5cf9 [Doc] Improve MM models LoRA notes (#31979) Jee Jee Li 2026-01-09 00:55:22 +08:00
• b8112c1d85 [Bugfix] Fix vllm serve failure with Nemotron Nano V3 FP8 (#31960) danisereb 2026-01-08 18:08:37 +02:00
• eaba8ece77 [Bugfix]: Fix Step3ReasoningParser missing is_reasoning_end_streaming (#31969) Chauncey 2026-01-08 23:28:13 +08:00
• fe86be66c5 [Model] Support IQuestCoder model (#31575) yxing-bj 2026-01-08 22:42:57 +08:00
• 1da3a5441a [Docs]: update claude code url (#31971) Chauncey 2026-01-08 22:04:55 +08:00
• 72c068b8e0 [CI] [Bugfix] Fix unbounded variable in run-multi-node-test.sh (#31967) TJian 2026-01-08 21:42:01 +08:00
• 7645bc524b [OpenAI] Fix tool_choice=required streaming when output has trailing extra data (#31610) MaryandChauncey 2026-01-08 13:01:42 +00:00
• 1123a87892 [Model] Enable LoRA support for Pixtral (#31724) Ce Zhaoand赵策 2026-01-08 08:00:57 -05:00
• 03fd76c570 [Model] Add LFM2-VL model support (#31758) 3 people 2026-01-08 05:00:27 -08:00
• 59d260f5e4 [Model] Add Grok-2 (#31847) Bijaya Dangol 2026-01-08 13:59:48 +01:00
• 18d4e481d0 [Voxtral] Fix speech transcription api (#31388) 9 people 2026-01-08 12:34:19 +02:00
• 2972a05473 [MM Encoder]: Make MMEncoderAttention's scale takes effect properly (#31950) Isotr0py 2026-01-08 18:33:48 +08:00
• 5576227bc1 [Model] Standardize common vision encoders (#31947) Cyrus Leung 2026-01-08 18:33:16 +08:00
• d1b6fe007f [Chore] Further cleanup pooler (#31951) Cyrus Leung 2026-01-08 18:16:21 +08:00
• 04a49669d1 RayLLM Bugfix - Preserve obj store URL for multi engine_config creation (#30803) 3 people 2026-01-08 12:00:25 +02:00
• 96fcd3c267 [Misc] Support qwen3-next lora (#31719) BingjiaWang 2026-01-08 17:27:50 +08:00
• 1f214290d6 fix(compile): apply partition wrapper when loading AOT cached functions (#31536) DevByteAIandLuka Govedič 2026-01-08 11:27:26 +02:00
• 8cbdc7eb94 [CI/Build] Enable test_kv_cache_events_dp for AMD (#31834) Ryan Rock 2026-01-08 03:00:24 -06:00
• b634e619bb Decouple page_size_bytes calculation in AttentionSpec for TPU/RPA Compatibility. (#31635) Lumosis 2026-01-08 01:00:07 -08:00
• eac3b96ec0 [Models] Allow converting Qwen3-VL into Reranker model (#31890) Isotr0py 2026-01-08 16:10:15 +08:00
• 573a1d1119 [ROCm]Skip test_torchao.py::test_pre_quantized_model on CDNA3 arch (#31905) Zhiwei 2026-01-08 15:47:44 +08:00
• 33156f56e0 [docker] A follow-up patch to fix #30913: [docker] install cuda13 version of lmcache and nixl (#31775) Shang Wang 2026-01-08 02:47:02 -05:00
• 107cf8e92f fix(rocm): Add get_supported_kernel_block_sizes() to ROCM_ATTN (#31712) Rabi Mishra 2026-01-08 13:16:07 +05:30
• 63baa28cf5 [Model] Enable LoRA support for tower and connector in GLM4-V (#31652) ZyyericandJee Jee Li 2026-01-08 01:45:53 -06:00
• e5173d3bac [Bugfix] Remove the num_hidden_layers override for glm4_moe (#31745) Andy Liu 2026-01-07 23:45:10 -08:00
• d3235cb503 [Fix] Enable mm_processor_cache with vision LoRA (#31927) prashanth058 2026-01-08 01:31:51 -06:00
• 287b37cda4 [BugFix] Fix spec decoding edge case bugs (#31944) Nick Hill 2026-01-07 23:31:03 -08:00
• 791b2fc30a [grpc] Support gRPC server entrypoint (#30190) 3 people 2026-01-07 23:24:46 -08:00
• be6a81f31b [chore] Update FA commit (#30460) Lucas Wilkinson 2026-01-08 02:24:18 -05:00
• 2ab441befe [platform] add dp_metadata arg to set_additional_forward_context (#31942) Ronald 2026-01-08 14:56:44 +08:00
• 9572f74f15 [Model] Enable LoRA support for tower and connector in DotsOCR (#31825) ShaanveerS 2026-01-08 07:50:16 +01:00
• 5f2a473ff3 [ROCm][CI] v1 cpu offloading attention backend fix (#31833) Andreas Karatzas 2026-01-08 00:37:50 -06:00
• 6b2a672e47 [Doc] Add Claude code usage example (#31188) Michael Goin 2026-01-08 00:50:23 -05:00
• f1b1bea5c3 [CI][BugFix][AMD] Actually skip tests marked @pytest.mark.skip_v1 (#31873) rasmithandRandall Smith 2026-01-07 23:06:09 -06:00
• cddbc2b4b2 [ROCm][CI] Add rocm support for run-multi-node-test.sh (#31922) Charlie Fuandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 2026-01-07 22:36:39 -06:00
• 087a138963 [ROCm][CI] Fix attention backend test flakiness from uninitialized KV cache memory (#31928) Andreas Karatzas 2026-01-07 22:35:25 -06:00
• c4041f37a4 [ROCm][LoRA] Fix MoE accuracy regression by preserving float32 router weight scaling (#31931) Andreas Karatzas 2026-01-07 22:17:56 -06:00
• a79079feef [BugFix] Fix flakiness in test_eagle_dp for PyTorch 2.10 (#31915) Richard Zou 2026-01-07 23:04:58 -05:00
• 9f6dcb71ae [MoE Refactor][16/N] Apply Refactor to NVFP4 (#31692) 4 people 2026-01-07 22:46:27 -05:00
• 8dd2419fa9 [CI] Skip Qwen-VL in multimodal processing tests due to flaky external dependency (#31932) Andreas Karatzas 2026-01-07 20:58:01 -06:00