vLLM/examples at fa5cfd48d561989d2f5e7fd42788e2f6cfb479c6 - vLLM

applications

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

basic

[feature] Watermarked generation and detection (Gumbel-max algorithm) (#54053 )

2026-09-09 21:00:15 -07:00

deployment

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

disaggregated

[Doc] Document ECMooncakeConnector for EPD disaggregation (#59196 )

2026-10-02 12:10:33 +08:00

features

[sharded state loader] support pp in sharded state loader (#52110 )

2026-10-09 11:08:31 -07:00

generate

[Frontend] Remove the slow tokenizer mode (#58545 )

2026-09-24 08:48:28 -07:00

observability

[Doc] Clarify ITL vs TPOT Prometheus metrics (#55283 )

2026-09-14 23:35:13 -07:00

pooling

[Model] Add zerank-2 reranker (#60415 )

2026-10-09 03:01:51 +00:00

ray_serving

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

reasoning

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

rl

[Docs][RL] Move pause/resume and batch invariance examples to examples/rl (#59949 )

2026-10-07 06:22:10 +00:00

scale_out

[Frontend] Replace VLLM_ENABLE_SCALE_OUT_ENDPOINTS with --enable-scale-out (#55176 )

2026-09-14 10:02:14 +00:00

speech_to_text

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

tool_calling

Add pydocstyle to the ruff rules (#52136 )

2026-09-16 16:44:29 +00:00

__init__.py

[Frontend] Consolidate scale out entrypoints (#44512 )

2026-06-29 03:18:53 -07:00

template_alpaca.jinja

Support chat template and echo for chat API (#1756 )

2023-11-30 16:43:13 -08:00

template_chatglm2.jinja

Add chat templates for ChatGLM (#3418 )

2024-03-14 23:19:22 -07:00

template_chatglm.jinja

Add chat templates for ChatGLM (#3418 )

2024-03-14 23:19:22 -07:00

template_chatml.jinja

Support chat template and echo for chat API (#1756 )

2023-11-30 16:43:13 -08:00

template_falcon_180b.jinja

Add chat templates for Falcon (#3420 )

2024-03-14 23:19:02 -07:00

template_falcon.jinja

Add chat templates for Falcon (#3420 )

2024-03-14 23:19:02 -07:00

template_inkbot.jinja

Support chat template and echo for chat API (#1756 )

2023-11-30 16:43:13 -08:00

template_teleflm.jinja

[Model] Support Tele-FLM Model (#15023 )

2025-03-22 02:04:44 -07:00

tool_chat_template_apertus.jinja

[Model] Add Apertus Tool Parser (#41154 )

2026-05-18 11:20:04 -04:00

tool_chat_template_deepseekr1.jinja

Fix DeepSeek-R1-0528 chat template (#20717 )

2025-07-10 17:47:36 +00:00

tool_chat_template_deepseekv3.jinja

[Feature] Support DeepSeekV3 Function Call (#17784 )

2025-05-12 00:45:21 -07:00

tool_chat_template_deepseekv31.jinja

Support DeepSeek-V3.1 tool call (#23454 )

2025-08-23 05:50:16 +00:00

tool_chat_template_functiongemma.jinja

[Frontend] add FunctionGemma tool parser support (#31218 )

2025-12-25 15:29:25 +08:00

tool_chat_template_gemma3_pythonic.jinja

[Misc] Add gemma3 chat template with pythonic-style function calling (#17149 )

2025-08-21 21:06:50 -07:00

tool_chat_template_gemma4.jinja

[Bugfix][Gemma4] Render reasoning on assistant turns without tool_calls (#45867 )

2026-06-17 20:44:15 +00:00

tool_chat_template_glm4.jinja

Fix GLM-4.6v flash tool calling in transformers 5.x (#31622 )

2026-01-05 11:32:43 -08:00

tool_chat_template_granite_20b_fc.jinja

[Model] tool calling support for ibm-granite/granite-20b-functioncalling (#8339 )

2024-10-29 15:07:37 -07:00

tool_chat_template_granite.jinja

[ROCm][CI] Stabilize Granite tool-use and test URL construction (#43017 )

2026-05-23 12:21:11 +08:00

tool_chat_template_hermes.jinja

[Bugfix] Fix Hermes tool call chat template bug (#8256 )

2024-09-07 10:49:01 +08:00

tool_chat_template_hunyuan_a13b.jinja

[Model] Add ToolParser and MoE Config for Hunyuan A13B (#20820 )

2025-07-17 09:10:09 +00:00

tool_chat_template_internlm2_tool.jinja

[Frontend][Feature] support tool calling for internlm/internlm2_5-7b-chat model (#8405 )

2024-10-04 10:36:39 +08:00

tool_chat_template_llama3.1_json.jinja

[Bugfix][Frontend] Update Llama Chat Templates to also support Non-Tool use (#10164 )

2024-11-23 10:17:38 +08:00

tool_chat_template_llama3.2_json.jinja

[Misc] Update llama 3.2 template to support system prompt with images (#10901 )

2024-12-05 05:54:06 +00:00

tool_chat_template_llama3.2_pythonic.jinja

[Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501 )

2025-04-06 07:44:36 +00:00

tool_chat_template_llama4_json.jinja

Add chat template for Llama 4 models (#16428 )

2025-04-24 20:19:36 +00:00

tool_chat_template_llama4_pythonic.jinja

[Frontend][Bug Fix] Update llama4 pythonic jinja template and llama4_pythonic parser (#17917 )

2025-05-22 16:44:08 -07:00

tool_chat_template_mistral3.jinja

[Bugfix] Fix tool call template validation for Mistral models (#17644 )

2025-05-08 09:47:19 +00:00

tool_chat_template_mistral_parallel.jinja

[Bugfix] example template should not add parallel_tool_prompt if tools is none (#9007 )

2024-10-03 03:04:17 +00:00

tool_chat_template_mistral.jinja

[Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistral models (#5649 )

2024-09-04 13:18:13 -07:00

tool_chat_template_muse_glimmer.jinja

Add Muse Glimmer model support (#51655 )

2026-08-14 12:28:56 +08:00

tool_chat_template_phi4_mini.jinja

[Doc]: fixing typos to improve docs (#24480 )

2025-09-08 23:06:04 -07:00

tool_chat_template_qwen3coder.jinja

[Bugfix]: Qwen3 Coder Tool Parser (#23099 )

2025-08-26 19:58:32 -07:00

tool_chat_template_toolace.jinja

[Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501 )

2025-04-06 07:44:36 +00:00

tool_chat_template_xlam_llama.jinja

Add xLAM tool parser support (#17148 )

2025-06-19 14:26:41 +08:00

tool_chat_template_xlam_qwen.jinja

Add xLAM tool parser support (#17148 )

2025-06-19 14:26:41 +08:00