iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
22,982 Commits 3 Branches 0 Tags
3f550129e8a3cc93bf33e8e6d304ec9c19d8e415
Commit Graph
82 Commits
Author SHA1 Message Date
Almog TavorandRobert Shaw 69d54eb078 [Docs] Fix broken llm-d.ai links on the llm-d integration page (#61022) 
Signed-off-by: Almog Tavor <almogtavor@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-10-12 21:26:43 +00:00
Harry MellorandClaude Opus 5.5 21d9758459 Remove Python 3.10 support now that it is EOL (#60402) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-08 02:30:52 -07:00
Zhou ZihangandJee Jee Li 3e67044972 [Doc] Refresh Kthena integration guide (#57314) 
Signed-off-by: Zhou Zihang <z@mcac.cc>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-09-21 01:42:55 +00:00
Alexander 5c642796e8 [Docs] Add Nebius Serverless AI deployment guide (#56414) 
Signed-off-by: Alexander Salikov <salikov57@gmail.com>
 2026-09-10 23:58:49 -07:00
wang.yuqi eac636a7fa [Frontend] Move api_server.py out openai folder (#52131) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-08-19 09:43:46 +00:00
Louie Tsai 5b184f775a connects vLLM Recipes with vLLM's native config-based deployment and benchmark (#51308) 
Signed-off-by: louie-tsai <louie.tsai@intel.com>
 2026-08-11 13:53:51 +00:00
Emmanuel Acheampong 3a79957b62 [Doc] Add Crusoe Managed Inference deployment guide (#49353) 
Signed-off-by: Emmanuel Acheampong <achampion.emma@gmail.com>
 2026-08-10 11:31:34 +01:00
IBRAHIM IBRAHIMibrahimibrahimClaude Opus 4.8
 		4fb483ca86 [Docs] Expand llm-d integration page (#45432) 
Signed-off-by: ibrahimibrahim <ibib2595@gmail.com>
Co-authored-by: ibrahimibrahim <ibib2595@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-28 15:47:56 +00:00
Nils Matteson 2e860de498 [Doc] Add compile cache volume example to the Docker deployment page (#49782) 
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com>
 2026-07-26 05:24:01 +00:00
rongfu.leng 3935829f89 [Docs] fix error key name (#48802) 
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
 2026-07-16 03:16:16 +00:00
Samuel Shen c9135db27c [Docs] Update stale LMCache examples (#45762) 
Signed-off-by: Samuel Shen <slshen@tensormesh.ai>
 2026-06-19 03:21:36 +00:00
Peter PanHarry MellorKyle SayersFlora Feng
 		3d300aecb1 [Doc] Switch K8S examples to default MP mode (#39400) 
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
 2026-06-10 18:17:11 +00:00
Nguyễn Thế DuyandClaude 3df1c7c43e [Docker] Non-root support for vllm-openai; add opt-in vllm-openai-nonroot target (#40275) 
Signed-off-by: TheDuyIT <nduy250299@gmail.com>
Signed-off-by: dtnguyen <dtnguyen@nvidia.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-05-25 13:45:31 +08:00
Florian WoernerandCyrus Leung 997132911e [Doc] Fix typo in llm-d documentation link (#42397) 
Signed-off-by: Florian Woerner <florian.woerner@onmyown.io>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2026-05-12 04:26:46 -07:00
Ethan Feng a43bc34baf [Docs] Update server entrypoint examples (#42077) 
Signed-off-by: Ethan Feng <ethan.fengch@gmail.com>
 2026-05-09 02:03:52 +00:00
wang.yuqiandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 1d694e78c9 [Examples][last/6] Resettle examples. (#41084) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-05-07 19:42:12 -07:00
wang.yuqiandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 51c1ee9b7c [Examples] Resettle Disaggregated examples. (#40759) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-05-06 01:20:38 -07:00
Honglin Cao 9c271f9403 [gRPC] Add standard gRPC health checking (grpc.health.v1) for Kubernetes native probes (#38016) 
Signed-off-by: Honglin Cao <Caohonglin317@hotmail.com>
 2026-04-22 21:31:00 +00:00
Yuichiro Utsumiandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> a1746ff9ec [Doc] Clarify Helm chart location in deployment guide (#38328) 
Signed-off-by: Yuichiro Utsumi <utsumi.yuichiro@fujitsu.com>
Signed-off-by: Yuichiro Utsumi <81412151+utsumi-fj@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-27 15:43:02 +08:00
Harry Mellor a0f44bb616 Allow markdownlint to run locally (#36398) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-08 20:05:24 -07:00
Paco Xu 7493c51c55 [Docs] add Dynamo/aibrix integration and kubeai/aks link (#32767) 
Signed-off-by: Paco Xu <paco.xu@daocloud.io>
 2026-03-05 17:39:50 +08:00
ChenandHarry Mellor 138c5fa186 [Docs] Add RunPod GPU deployment guide for vLLM (#34531) 
Signed-off-by: lisperz <zhuchen200245@163.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-04 10:11:34 -08:00
vllmellmTJianHarry Mellor
 		aaa2efbe98 [DOC] [ROCm] Update docker deployment doc (#33971) 
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-02-06 10:05:35 -08:00
Nathan Weinberg 58cb55e4de [Doc] Enhance documentation around CPU container images (#32286) 
Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
 2026-01-30 13:36:20 +00:00
Andrew Bennett f243abc92d Fix various typos found in docs (#32212) 
Signed-off-by: Andrew Bennett <potatosaladx@meta.com>
 2026-01-13 03:41:47 +00:00
Harry Mellor decc244767 [Docs] Use relative md links instead of absolute html links for cross referencing (#31494) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-12-29 13:33:44 +00:00
yitingdc b326598e97 add tip for VLLM_USE_PRECOMPILED arg to reduce docker build time (#31385) 
Signed-off-by: yiting.jiang <yiting.jiang@daocloud.io>
 2025-12-28 03:19:47 +00:00
Yuan Tang 0736f901e7 docs: Add llm-d integration to the website (#31234) 
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
 2025-12-23 20:27:22 +00:00
Didier DurandandWentao Ye 1a55cfafcb [Doc]: fixing typos in various files (#30540) 
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2025-12-14 02:14:37 -08:00
Qidong Su 24429d5924 [Doc] Add instructions for building docker image on GB300 with CUDA13 (#30414) 
Signed-off-by: Qidong Su <soodoshll@gmail.com>
 2025-12-13 21:56:53 +00:00
Tiger Xu / Zhonghu Xu 60a66ea2dc [DOC]: Add kthena to integrations (#29931) 
Signed-off-by: Zhonghu Xu <xuzhonghu@huawei.com>
 2025-12-05 08:11:03 +00:00
Yuan Tang f716a15372 Update KServe guide link in documentation (#29258) 
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
 2025-11-24 14:40:05 +00:00
Cyrus Leung 9452863088 Revert "Revert #28875 (#29159)" (#29179) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-11-21 04:27:43 -08:00
Cyrus Leung 4d7231e774 Revert #28875 (#29159) 2025-11-21 01:40:17 -08:00
Qidong SuandCyrus Leung 698024ecce [Doc] update installation guide regarding aarch64+cuda pytorch build (#28875) 
Signed-off-by: Qidong Su <soodoshll@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-11-20 19:40:25 -08:00
Didier Durand 09540cd918 [Doc]: fix typos in various files (#29010) 
Signed-off-by: Didier Durand <durand.didier@gmail.com>
 2025-11-19 04:56:21 -08:00
Harry Mellor 67187554dd [Docs] Enable some more markdown lint rules for the docs (#28731) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-11-14 18:39:19 +00:00
Harry Mellor 5f3cd7f7f2 [Docs] Update the name of Transformers backend -> Transformers modeling backend (#28725) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-11-14 16:34:14 +00:00
Fang Han da855b42d2 [Doc]: Make extraInit containers fully configurable in helm chart (#27497) 
Signed-off-by: Fang Han <fhan0520@gmail.com>
 2025-11-06 20:27:16 +00:00
yitingdc 31b55ffc62 use stringData in secret yaml to store huggingface token (#25685) 
Signed-off-by: yiting.jiang <yiting.jiang@daocloud.io>
 2025-10-30 00:47:36 -07:00
usberkeley 69f064062b Code quality improvements: version update, type annotation enhancement, and enum usage simplification (#27581) 
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
 2025-10-27 17:50:22 +00:00
Harry Mellor 483ea64611 [Docs] Replace all explicit anchors with real links (#27087) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-17 02:22:06 -07:00
Harry Mellor 4ffd6e8942 [Docs] Reduce custom syntax used in docs (#27009) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-16 20:05:34 -07:00
Kay Yan 02d709a6f1 [docs] standardize Hugging Face env var to HF_TOKEN (deprecates HUGGING_FACE_HUB_TOKEN) (#27020) 
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
 2025-10-16 15:31:02 +01:00
Cyrus Leung ef9676a1f1 [Doc] ruff format some Python examples (#26767) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-14 03:21:53 -07:00
abhisheksheth28 77c95f72f7 [Doc] add KAITO to integrations (#25521) 
Signed-off-by: "Abhishek Sheth" <absheth@microsoft.com>
 2025-10-06 17:30:03 +08:00
Aritra Roy Gosthipaty 59f30d0448 [Docs] Edit HF Inference Endpoints documentation (#26275) 
Signed-off-by: Aritra Roy Gosthipaty <aritra.born2fly@gmail.com>
Signed-off-by: ariG23498 <aritra.born2fly@gmail.com>
 2025-10-06 10:13:09 +01:00
Elieser Pereira f509a20846 [DOC] Update production-stack.md (#26177) 
Signed-off-by: Elieser Pereira <elieser.pereiraa@gmail.com>
 2025-10-05 21:32:48 +00:00
Cyrus Leung d00d652998 [CI/Build] Replace vllm.entrypoints.openai.api_server entrypoint with vllm serve command (#25967) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-02 10:04:57 -07:00
Sergio Paniego BlancoandHarry Mellor 099aaee536 Add Hugging Face Inference Endpoints guide to Deployment docs (#25886) 
Signed-off-by: sergiopaniego <sergiopaniegoblanco@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-09-30 14:35:06 +00:00