iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
20,845 Commits 3 Branches 0 Tags
78300cdabffbaaffe7625ed34412ec2aec75535c
Commit Graph
164 Commits
Author SHA1 Message Date
Roberto L. CastroandCodex e16b5e518d [1/N][warmup][DSv4] Migrate generic MLA metadata and indexing kernels (#50175) 
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Codex <codex@openai.com>
 2026-08-31 23:26:05 -04:00
Bugen Zhao b131311fb4 [CI/Build] Add advisory PR title format check (#54263) 2026-08-28 15:50:47 -07:00
Jung Jiyu 3bb19cd8a3 [Bugfix][CI/Build] Fail closed when selected precompiled CUDA variant is unavailable (#52545) 
Signed-off-by: Jung Jiyu <jiyu.jung@navercorp.com>
 2026-08-28 17:00:48 +08:00
Shang Wangandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 9650dc73e2 [CI/Build][Hardware][NVIDIA] Add opt-in Rubin Docker builds (#53443) 
Signed-off-by: Shang Wang <samshang.wang@mail.utoronto.ca>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-27 16:06:44 +00:00
Harry MellorXianbao QIANClaude Opus 5
 		7ca336929c [Model] Remove ten deprecated model architectures (#53608) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-24 17:06:00 -07:00
Cyrus LeungandQwen Code ebcd606467 [MM] Simplify prompt updates: replace PromptSeq with list[int] (#53372) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Qwen Code <noreply@alibaba-inc.com>
 2026-08-23 14:50:32 +08:00
Cyrus Leung 0b19ebcacd [MM] Simplify _apply_hf_processor_main (#53275) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-08-22 01:49:37 -07:00
Cyrus Leung b00f475f09 [MM] Remove text components from ProcessorInputs (#53093) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-08-20 20:42:53 -07:00
jcotant-inferactClaude Opus 5mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		c205726108 [CI] Fix and extend PR/issue auto-labeling (#51459) 
Signed-off-by: Joe Cotant <joe@inferact.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-19 21:45:44 +00:00
Andreas Karatzas 203926c477 [ROCm][CI] Add AMD CI Pull-Request Commands (#52822) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-18 15:16:25 -07:00
Roberto L. CastroandCodex 49905ad94d [3/N][Feat][Perf] Add new warmup infrastructure for JITs. Add provider registry and orchestration for JIT warmup (#50174) 
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Codex <codex@openai.com>
 2026-08-17 10:11:14 -07:00
鐘天楽 a367cdbca0 [Profiler] Add minimal Triton Proton profiling backend (#48789) 
Signed-off-by: Luossu <zhluosuu@outlook.com>
 2026-08-11 14:51:57 -07:00
Michael GoinOpenAI CodexOpenAI Codex
 		21c667aa64 [Docker] Cache test dependencies before vLLM install (#51184) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-08-10 10:34:59 -07:00
Kevin H. LuuandOpenAI Codex 7f4c52f2ba [CI] Add comment-based Buildkite triggers (#50132) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-28 18:41:48 -07:00
TobyJBell 15d65f8669 [Bugfix] Changed speech to text chunk timestamp to cumulative approach (#41131) 
Signed-off-by: Toby Bell <toby.bell1702@hotmail.co.uk>
 2026-07-27 17:06:46 +00:00
Kevin H. LuuandOpenAI Codex 867ff69733 [CI] Gate non-default release wheel builds (#48772) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-07-17 02:16:44 -07:00
Andrey TalmanAndrey TalmanKevin H. Luu
 		f36284a8d2 [CI] Add TORCH_NIGHTLY=1 build mode (run full suite on torch nightly) (#47180) 
Co-authored-by: Andrey Talman <atalman@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
 2026-07-10 01:38:35 -07:00
Tiezhen WANGHarry MellorCyrus Leung
 		412414d8e0 Remove PersimmonForCausalLM and FuyuForCausalLM model architectures (#48096) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-07-09 04:59:08 -07:00
Nick Cao 47c40bfe8a [Doc] Fix manylinux tag in installation guide (#47913) 
Signed-off-by: Nick Cao <ncao@redhat.com>
 2026-07-07 20:34:05 +00:00
Simon MoandOpenAI Codex 6871738777 [Doc] Document pull request limit (#46376) 
Signed-off-by: simon-mo <simon.mo@hey.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-06-22 14:04:56 +00:00
Tiezhen WANGClaudemergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		d14e551a53 [Model] Remove MiniMaxText01, MiniMaxVL01, MiniMaxForCausalLM (#45993) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-22 15:20:46 +08:00
Harry Mellor 0a49fb2b13 Fix dead link in docs (#46181) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-19 18:16:09 +00:00
Michael GoinandClaude Fable 5 bd59c913bc [CI] ci-fetch-log.sh: fetch all failed jobs from a build URL or PR number (#45274) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-06-12 00:42:18 -07:00
Harry Mellor 3cc9fecd58 Deprecated 1st generation Qwen and QwenVL models (#45131) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-10 14:55:33 +00:00
Harry Mellor ef0df7dbd6 [CI] Bump mypy version 1.19.1 -> 1.20.2 (#44647) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-05 14:56:27 +00:00
Daoyuan Li bd98e97557 [Misc] Remove dead VLLM_RPC_TIMEOUT env var and fix profiling doc that references it (#44128) 
Signed-off-by: Daoyuan Li <94409450+DaoyuanLi2816@users.noreply.github.com>
 2026-06-03 00:22:10 +00:00
Wentao Yeandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> c02c758ea4 [Deprecation] Deprecate functions as scheduled for v0.21.0 (#43358) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-26 19:56:21 -07:00
Roy Wang 0c942c69d6 [Doc] Add section on escalating stalled contributions (#43568) 
Signed-off-by: esmeetu <jasonailu87@gmail.com>
 2026-05-25 14:11:01 +08:00
Nick HillandBugen Zhao f2ace1d57d [Frontend][RFC] Rust front-end integration (#40848) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
 2026-05-21 12:24:48 +08:00
Juan Pérez de Algabaandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 5a6a9fc6f6 [docs] Added one new contact to the Vulnerability Management team (#42145) 
Signed-off-by: jperezde <jperezde@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-12 10:59:59 -04:00
wangxiyuan 5536fc0c01 [Misc] Replace mamba_type string literals with MambaAttentionBackendEnum (#41188) 
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
 2026-05-11 03:59:36 +00:00
wang.yuqiandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 1d694e78c9 [Examples][last/6] Resettle examples. (#41084) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-05-07 19:42:12 -07:00
Michael GoinandClaude Opus 4.7 4f7309fcc0 [CI] Add ci-fetch-log.sh helper for Buildkite job logs (#41517) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-02 15:23:59 -07:00
wang.yuqi a8208e6a81 [Examples] Resettle features examples. (#40995) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-04-28 00:33:41 -07:00
Ekagra Ranjangemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Cyrus Leung
 		4eafc72928 [Audio] Bundle get_generation_prompt() params into SpeechToTextParams (#36268) 
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2026-04-22 12:24:18 +08:00
Wentao Ye 301024aa9c [Deprecation] Deprecate cprofile and cprofile_context (#39100) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-04-21 11:25:22 +08:00
Nick CaoandClaude 153ba7f0f3 [Refactor] Drop direct dependency on librosa (#39079) 
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-04-18 06:55:38 +00:00
Harry MellorandRobert Shaw fc645f1acc Add structure to requirements/ directory (#39024) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-04-10 13:46:41 -07:00
Cyrus Leung ba2f0acc2d [Misc] Reorganize inputs (#35182) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-25 10:22:54 -07:00
Ben Browning a1a2566447 [Docs] Add guide for editing agent instruction files (#37819) 
Signed-off-by: Ben Browning <bbrownin@redhat.com>
 2026-03-25 13:54:09 +00:00
Jee Jee Li dd20ee4e3e [UX] Enable torch_profiler_with_stack (#37571) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-03-20 11:17:26 +00:00
wang.yuqiCyrus LeungHarry Mellor
 		f9e2a38386 [Docs] Reorganize pooling docs. (#35592) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-19 11:25:47 +00:00
SoluMilkenandHarry Mellor d8f8a7aad2 [Misc] Sync pre-commit to 4.5.1 in workflows and docs (#36675) 
Signed-off-by: SoluMilken <ypiheyn.imm02g@g2.nctu.edu.tw>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-16 10:03:21 +00:00
Harry Mellorandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> e39257a552 Add AGENTS.md (#36877) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-12 10:20:50 -07:00
Mark McLoughlin 5282c7d4d0 [docs] Add lightweight AI assisted contribution policy (#30947) 
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
 2026-03-12 11:46:13 +00:00
Harry Mellor a0f44bb616 Allow markdownlint to run locally (#36398) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-08 20:05:24 -07:00
Abhishek Mathukiya f3dc292e9f docs: add version requirement note for --profiler-config flag (#32454) 
Signed-off-by: abhishkh <mathukiya.a@northeastern.edu>
 2026-03-04 18:13:54 +00:00
jonoillarandJon OILLARBURU 26e722f906 [DOC][BugFix] Specfiy build dependency installation (#34513) 
Signed-off-by: Jon OILLARBURU <jon.oillarburu@multiversecomputing.com>
Co-authored-by: Jon OILLARBURU <jon.oillarburu@multiversecomputing.com>
 2026-02-25 08:04:06 +00:00
Cyrus Leung 987506bca6 [Refactor] Simplify dummy data generation (#35025) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-02-22 20:55:27 -08:00
rinbaro 007b183d74 [docs] fix unintentional misspellings (#33863) 
Signed-off-by: rinbaro <ilgomishra@gmail.com>
 2026-02-04 20:50:59 -08:00