Commit Graph

Select branches

Hide Pull Requests

main

patches

sm86

Mono Color

• b63bd14999 Reinstate format.sh and make pre-commit installation simpler (#15890) Harry Mellor 2025-04-01 16:41:30 +01:00
• 2041c0e360 [Doc] Quark quantization documentation (#15861) chaow-amd 2025-04-01 23:32:45 +08:00
• 085cbc4f9f [New Model]: jinaai/jina-reranker-v2-base-multilingual (#15876) wang.yuqiandDarkLight1337 2025-04-01 23:32:26 +08:00
• 2b93162fb0 Remove format.sh as it's been unsupported >70 days (#15884) Harry Mellor 2025-04-01 15:27:46 +01:00
• 2e45bd29fe [Misc] remove unused script (#15746) Reidandreidliu41 2025-04-01 21:58:05 +08:00
• 51d7c6a2b2 [Model] Support Mistral3 in the HF Transformers format (#15505) 3 people 2025-04-01 07:10:05 -06:00
• f3aca1ee30 setup correct nvcc version with CUDA_HOME (#15725) Yang Chen 2025-04-01 06:09:40 -07:00
• 8dd41d6bcc [Misc] Use envs.VLLM_USE_RAY_COMPILED_DAG_CHANNEL_TYPE (#15831) 3 people 2025-04-01 06:07:53 -07:00
• 0a298ea418 [Bugfix] Fix no video/image profiling edge case for MultiModalDataParser (#15828) Isotr0py 2025-04-01 18:17:11 +08:00
• d330558bab [Docs] Fix small error in link text (#15868) Harry Mellor 2025-04-01 11:05:14 +01:00
• 656fd72976 [Misc] Fix speculative config repr string (#15860) shangmingc 2025-04-01 17:26:22 +08:00
• 79455cf421 [Misc] Enable V1 LoRA by default (#15320) Varun Sundar RabindranathandVarun Sundar Rabindranath 2025-04-01 04:53:56 -04:00
• 30d6a015e0 [Feature] specify model in config.yaml (#15798) Wei Zeng 2025-04-01 01:20:06 -07:00
• 8af5a5c4e5 fix: can not use uv run collect_env close #13888 (#15792) yihong 2025-04-01 15:45:49 +08:00
• 3a5f0afcd2 [V1] Implement sliding window attention in kv_cache_manager (#14097) Chen Zhang 2025-04-01 15:33:17 +08:00
• c7e63aa4d8 [ROCm] Use device name in the warning (#15838) Gregory Shtrasberg 2025-04-01 03:10:48 -04:00
• 4a9ce1784c [sleep mode] clear pytorch cache after sleep (#15248) Lionel Villard 2025-04-01 01:58:58 -04:00
• 7e4e709b43 [V1] TPU - Fix fused MOE (#15834) Alexander Matveev 2025-04-01 01:58:07 -04:00
• 63d8eabed0 [Bugfix]: Fix is_embedding_layer condition in VocabParallelEmbedding (#15824) Alexey Kiryushin 2025-04-01 05:57:59 +00:00
• e830b01383 [Bugfix] Fix extra comma (#15851) Percy 2025-04-01 00:57:28 -05:00
• ff6473980d [Bugfix][Model] fix mllama multi-image (#14883) Yan Ma 2025-04-01 13:53:37 +08:00
• a164aea35d [Frontend] Add Phi-4-mini function calling support (#14886) KinfeyandCyrus Leung 2025-04-01 13:50:05 +08:00
• a76f547e11 Rename fallback model and refactor supported models section (#15829) Harry Mellor 2025-04-01 06:49:41 +01:00
• b7b7676d67 [Distributed] Add custom allreduce support for ROCM (#14125) Ilya Markovandilmarkov 2025-04-01 07:49:12 +02:00
• e6e3c55ef2 Move dockerfiles into their own directory (#14549) Harry Mellor 2025-03-31 21:47:32 +01:00
• f98a4920f9 [V1][Core] Remove unused speculative config from scheduler (#15818) Mark McLoughlin 2025-03-31 20:15:21 +01:00
• d4bfc23ef0 Fix Transformers backend compatibility check (#15290) Harry Mellor 2025-03-31 18:27:07 +01:00
• 9a2160fa55 [V1] TPU CI - Add basic perf regression test (#15414) Alexander Matveev 2025-03-31 13:25:20 -04:00
• 2de4118243 fix: change GB to GiB in logging close #14979 (#15807) yihong 2025-04-01 01:00:50 +08:00
• 239b7befdd [V1][Spec Decode] Remove deprecated spec decode config params (#15466) shangmingc 2025-04-01 00:19:35 +08:00
• 09e974d483 [Bugfix] Check dimensions of multimodal embeddings in V1 (#15816) Cyrus Leung 2025-04-01 00:01:35 +08:00
• e5ef4fa99a Upgrade transformers to v4.50.3 (#13905) Harry Mellor 2025-03-31 16:59:37 +01:00
• 037bcd942c [Bugfix] Fix missing return value in load_weights method of adapters.py (#15542) Mrm 2025-03-31 21:56:42 +08:00
• c2e7507ad4 [Bugfix] Fix Crashing When Loading Modules With Batchnorm Stats (#15813) Alex Brooks 2025-03-31 07:23:53 -06:00
• 3aa2b6a637 [Model] Update support for NemotronNAS models (#15008) Naveassaf 2025-03-31 15:35:14 +03:00
• 555aa21905 [V1] Fully Transparent Implementation of CPU Offloading (#15354) youkaichao 2025-03-31 20:22:34 +08:00
• e7ae3bf3d6 fix: better install requirement for install in setup.py (#15796) yihong 2025-03-31 20:13:32 +08:00
• b932c048ac Recommend developing with Python 3.12 in developer guide (#15811) Harry MellorandCyrus Leung 2025-03-31 12:54:49 +01:00
• e85829450d [Feature][ROCm]Enable fusion pass for torch.compile on ROCm (#15050) Charlie Fu 2025-03-31 06:42:18 -05:00
• effc5d24fa [Benchmark] Update Vision Arena Dataset and HuggingFaceDataset Setup (#15748) Jennifer Zhao 2025-03-31 00:38:58 -07:00
• 18ed3132d2 [Misc] update the comments (#15780) Chengyang LIUandchengyang liu 2025-03-30 19:39:56 -07:00
• 9b459eca88 [V1][Scheduler] Avoid calling _try_schedule_encoder_inputs for every request (#15778) Woosuk Kwon 2025-03-30 14:10:42 -07:00
• 70fedd0f79 fix: Comments to English for better dev experience (#15768) yihong 2025-03-31 01:47:57 +08:00
• bb103b29bf [Bugfix] Added embed_is_patch mask for fuyu model (#15731) kYLe 2025-03-30 05:45:08 -05:00
• 248e76c4df fix: lint fix a ruff checkout syntax error (#15767) yihong 2025-03-30 18:36:02 +08:00
• 803d5c35f3 [V1] Override mm_counts for dummy data creation (#15703) Cyrus Leung 2025-03-30 18:20:42 +08:00
• 7fd8c0f85c fix test_phi3v (#15321) pansicheng 2025-03-30 17:01:34 +08:00
• 44c3a5abc3 [doc] update conda to usage link in installation (#15761) Reidandreidliu41 2025-03-30 16:12:13 +08:00
• 6909a76201 [Bugfix] Fix Mistral guided generation using xgrammar (#15704) Julien Denize 2025-03-30 05:20:19 +02:00
• 045533716b [CI] xgrammar structured output supports Enum. (#15757) Chauncey 2025-03-30 11:20:02 +08:00
• 3c0ff914ac [Bugfix] Fix Mllama interleaved images input support (#15564) Isotr0pyandChen Zhang 2025-03-30 02:11:15 +08:00
• 2bc4be4e32 [V1][Minor] Simplify rejection sampler's parse_output (#15741) Woosuk Kwon 2025-03-29 09:25:17 -07:00
• c67abd614f [V1] Support interleaved modality items (#15605) Roger Wang 2025-03-29 06:30:09 -07:00
• 6fa7cd3dbc [Feature][Disaggregated] Support XpYd disaggregated prefill with MooncakeStore (#12957) shangmingc 2025-03-29 19:01:46 +08:00
• 94744ba41a [V1] [Feature] Collective RPC (#15444) wwl2755 2025-03-29 05:39:14 -05:00
• 4965ec42d2 [FEAT] [ROCm] Add AITER int8 scaled gemm kernel (#15433) TJian 2025-03-29 18:33:56 +08:00
• 73aa7041bf [doc] update doc (#15740) Reidandreidliu41 2025-03-29 12:27:22 +08:00
• 7c1f760024 [Kernel][TPU][ragged-paged-attn] vLLM code change for PR#8896 (#15659) yarongmu-google 2025-03-28 21:13:15 -07:00
• da461f3cbf [TPU][V1][Bugfix] Fix w8a8 recompiilation with GSM8K (#15714) Nicolò Lucchesi 2025-03-29 05:13:06 +01:00
• 5b800f0932 [Bugfix] set VLLM_WORKER_MULTIPROC_METHOD=spawn for vllm.entrypoionts.openai.api_server (#15700) Jinzhen Lin 2025-03-29 12:12:26 +08:00
• 8427f70493 Use numba 0.61 for python 3.10+ to support numpy>=2 (#15692) cyyever 2025-03-29 12:11:51 +08:00
• 7a7992085b [CI] Speed up V1 structured output tests (#15718) Russell Bryant 2025-03-29 00:10:45 -04:00
• 1286211f57 [Bugfix] LoRA V1: add and fix entrypoints tests (#15715) Varun Sundar RabindranathandVarun Sundar Rabindranath 2025-03-28 21:10:41 -07:00
• 6d531ad7b8 [Misc][V1] Misc code streamlining (#15723) Nick Hill 2025-03-28 20:59:47 -07:00
• 762b424a52 [Docs] Document v0 engine support in reasoning outputs (#15739) Ce Gao 2025-03-29 11:46:57 +08:00
• de1cb38769 [Model] Support Skywork-R1V (#15397) pengyuangeandjiacai.liu 2025-03-29 11:39:21 +08:00
• c802f5430d [ROCm][AMD][Build] Update AMD supported arch list (#15632) Gregory Shtrasberg 2025-03-28 23:39:18 -04:00
• cff8991a50 [Docs][V1] Optimize diagrams in prefix caching design (#15716) simpx 2025-03-29 11:33:58 +08:00
• f3f8d8fff4 implement prometheus fast-api-instrumentor for http service metrics (#15657) daniel-salib 2025-03-28 17:12:02 -07:00
• 26df46ee59 [Misc] cli auto show default value (#15582) Reid 2025-03-29 06:23:00 +08:00
• c3f687ac22 [V1] TPU - Fix the chunked prompt bug (#15713) Alexander Matveev 2025-03-28 16:19:04 -04:00
• 04437e313d [Bugfix] [torch.compile] Add Dynamo metrics context during compilation (#15639) Luka Govedič 2025-03-28 16:01:09 -04:00
• 038bededba [TPU] [Perf] Improve Memory Usage Estimation (#15671) Robert ShawandRobert Shaw 2025-03-28 10:37:52 -07:00
• d03308be0c [Misc] Remove stale func in KVTransferConfig (#14746) shangmingc 2025-03-29 01:33:32 +08:00
• c6bc0034d0 [Misc] Remove unused utils and clean up imports (#15708) Cyrus Leung 2025-03-29 00:41:16 +08:00
• 70e132244a [Minor] Remove TGI launching script (#15646) Woosuk Kwon 2025-03-28 09:30:08 -07:00
• 47e9038d23 Fix cpu offload testing for gptq/awq/ct (#15648) Michael Goin 2025-03-28 10:29:32 -06:00
• 432cf22a6a [Bugfix] Fix regex compile display format (#15368) Kebe 2025-03-28 23:58:44 +08:00
• 2914006fe0 [doc] add missing imports (#15699) Reidandreidliu41 2025-03-28 23:56:48 +08:00
• 7329ff5468 [V1] Support disable_any_whtespace for guidance backend (#15584) Russell Bryant 2025-03-28 11:46:45 -04:00
• 541d1df486 [Bugfix] embed_is_patch for Idefics3 (#15696) Cyrus Leung 2025-03-28 23:27:52 +08:00
• 3b00ff9138 [Bugfix][v1] xgrammar structured output supports Enum. (#15594) Chauncey 2025-03-28 21:14:53 +08:00
• 91276c5721 [Model] Adding torch compile annotations to chatglm (#15624) Jee Jee Li 2025-03-28 21:14:09 +08:00
• 0b4167526d [Docs] Add "Generation quality changed" section to troubleshooting (#15701) Harry Mellor 2025-03-28 13:03:21 +00:00
• fd5fd26902 [Frontend] update priority for --api-key and VLLM_API_KEY (#15588) Reidandreidliu41 2025-03-28 19:40:12 +08:00
• 3bbaacbe15 [Bugfix][Frontend] Eliminate regex based check in reasoning full generator (#14821) Ce Gao 2025-03-28 19:20:35 +08:00
• a10314c6b3 [Misc] Fix test_sleep to use query parameters (#14373) Lize Caiandyoukaichao 2025-03-28 19:00:14 +09:00
• 70f2c2a709 [Bugfix] Fix 'InductorAdaptor object has no attribute 'cache_dir' (#15674) Jee Jee Li 2025-03-28 17:10:40 +08:00
• 280d074103 [CPU][CI] Improve CPU Dockerfile (#15690) Li, Jiang 2025-03-28 16:36:31 +08:00
• 32b14baf8a [Refactor][Frontend] Keep all logic about reasoning into one class (#14428) Ce Gao 2025-03-28 15:23:30 +08:00
• 2d9045fce8 [TPU][CI] Fix TPUModelRunner Test (#15667) Robert ShawandRobert Shaw 2025-03-28 03:01:26 -04:00
• 355f66348c [V1] Remove legacy input registry (#15673) Cyrus Leung 2025-03-28 14:34:34 +08:00
• 8693e47e6a [Bugfix] Fix mm_hashes forgetting to be passed (#15668) Cyrus Leung 2025-03-28 13:51:05 +08:00
• cec8c7d7f8 Refactor error handling for multiple exceptions in preprocessing (#15650) Jason (Siyu) Zhu 2025-03-27 20:27:20 -07:00
• 4d0ec37267 [Quantization][FP8] Adding support for fp8 gemm layer input in fp8 (#14578) Gregory ShtrasbergandLuka Govedič 2025-03-27 22:58:16 -04:00
• e7f720ea56 [Misc]add coding benchmark for speculative decoding (#15303) Chen Xia 2025-03-27 19:47:05 -07:00
• 4ae17bf1e2 Revert "Use Cache Hinting for fused_moe kernel (#15511)" (#15645) Wes 2025-03-27 20:45:55 -06:00
• 8a49eea74b [CI][TPU] Temporarily Disable Quant Test on TPU (#15649) Robert Shaw 2025-03-27 22:45:05 -04:00
• b4245a48df [Doc] Fix dead links in Job Board (#15637) wwl2755 2025-03-27 21:43:40 -05:00
• 4e0f6076be [Bugfix] Fix failure to launch in Tensor Parallel TP mode on macOS. (#14948) Kebeandyoukaichao 2025-03-28 10:13:41 +08:00