iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
Files
6fbb00b18874e27ba7d7adc0a3b8e93fee763ab1
vLLM/examples
T
History
Teng MaCursorTianyu GuoZhou zihengjiangkuaixue123OpenAI Codex
 6fbb00b188 [EPD] Add ECMooncakeConnector for encoder cache over Mooncake TransferEngine (#41567) 
Signed-off-by: Teng Ma <sima.mt@alibaba-inc.com>
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Signed-off-by: Zhou ziheng <jiaranran2@gmail.com>
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Tianyu Guo <guoty@inferact.ai>
Co-authored-by: Zhou ziheng <jiaranran2@gmail.com>
Co-authored-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-09-07 06:21:43 +00:00
..
applications
[Frontend] Move api_server.py out openai folder (#52131)
2026-08-19 09:43:46 +00:00
basic
[Deprecate] Deprecate LLM.reward offline api, use LLM.encode instead. (#40688)
2026-04-24 05:37:50 +00:00
deployment
[Bugfix][Helm] Fix chart resource references (#51664)
2026-08-14 17:47:42 +08:00
disaggregated
[EPD] Add ECMooncakeConnector for encoder cache over Mooncake TransferEngine (#41567)
2026-09-07 06:21:43 +00:00
features
[Core][KV Events] Echo session_id on GPU BlockStored events (#51381)
2026-09-04 02:22:50 +00:00
generate
[Model] Remove ten deprecated model architectures (#53608)
2026-08-24 17:06:00 -07:00
observability
[Examples][last/6] Resettle examples. (#41084)
2026-05-07 19:42:12 -07:00
pooling
[Bugfix][Frontend] Let pooling requests set padding (#51157)
2026-08-27 11:06:20 +00:00
ray_serving
[Doc] Switch K8S examples to default MP mode (#39400)
2026-06-10 18:17:11 +00:00
reasoning
[Examples] Resettle generate examples. (#36464)
2026-04-27 07:48:37 +00:00
rl
[RL] Support checkpoint-coordinate sparse NCCL weight updates (#53751)
2026-08-27 18:19:51 +08:00
scale_out
[Frontend] Gate scale-out endpoints behind opt-in flag (#54579)
2026-09-02 14:31:14 +08:00
speech_to_text
[Model] Remove ten deprecated model architectures (#53608)
2026-08-24 17:06:00 -07:00
tool_calling
[Bugfix] Fix broken example opeanai client (#41088)
2026-04-28 04:43:04 +00:00
__init__.py
[Frontend] Consolidate scale out entrypoints (#44512)
2026-06-29 03:18:53 -07:00
template_alpaca.jinja
Support chat template and echo for chat API (#1756)
2023-11-30 16:43:13 -08:00
template_chatglm2.jinja
Add chat templates for ChatGLM (#3418)
2024-03-14 23:19:22 -07:00
template_chatglm.jinja
Add chat templates for ChatGLM (#3418)
2024-03-14 23:19:22 -07:00
template_chatml.jinja
Support chat template and echo for chat API (#1756)
2023-11-30 16:43:13 -08:00
template_falcon_180b.jinja
Add chat templates for Falcon (#3420)
2024-03-14 23:19:02 -07:00
template_falcon.jinja
Add chat templates for Falcon (#3420)
2024-03-14 23:19:02 -07:00
template_inkbot.jinja
Support chat template and echo for chat API (#1756)
2023-11-30 16:43:13 -08:00
template_teleflm.jinja
[Model] Support Tele-FLM Model (#15023)
2025-03-22 02:04:44 -07:00
tool_chat_template_apertus.jinja
[Model] Add Apertus Tool Parser (#41154)
2026-05-18 11:20:04 -04:00
tool_chat_template_deepseekr1.jinja
Fix DeepSeek-R1-0528 chat template (#20717)
2025-07-10 17:47:36 +00:00
tool_chat_template_deepseekv3.jinja
[Feature] Support DeepSeekV3 Function Call (#17784)
2025-05-12 00:45:21 -07:00
tool_chat_template_deepseekv31.jinja
Support DeepSeek-V3.1 tool call (#23454)
2025-08-23 05:50:16 +00:00
tool_chat_template_functiongemma.jinja
[Frontend] add FunctionGemma tool parser support (#31218)
2025-12-25 15:29:25 +08:00
tool_chat_template_gemma3_pythonic.jinja
[Misc] Add gemma3 chat template with pythonic-style function calling (#17149)
2025-08-21 21:06:50 -07:00
tool_chat_template_gemma4.jinja
[Bugfix][Gemma4] Render reasoning on assistant turns without tool_calls (#45867)
2026-06-17 20:44:15 +00:00
tool_chat_template_glm4.jinja
Fix GLM-4.6v flash tool calling in transformers 5.x (#31622)
2026-01-05 11:32:43 -08:00
tool_chat_template_granite_20b_fc.jinja
[Model] tool calling support for ibm-granite/granite-20b-functioncalling (#8339)
2024-10-29 15:07:37 -07:00
tool_chat_template_granite.jinja
[ROCm][CI] Stabilize Granite tool-use and test URL construction (#43017)
2026-05-23 12:21:11 +08:00
tool_chat_template_hermes.jinja
[Bugfix] Fix Hermes tool call chat template bug (#8256)
2024-09-07 10:49:01 +08:00
tool_chat_template_hunyuan_a13b.jinja
[Model] Add ToolParser and MoE Config for Hunyuan A13B (#20820)
2025-07-17 09:10:09 +00:00
tool_chat_template_internlm2_tool.jinja
[Frontend][Feature] support tool calling for internlm/internlm2_5-7b-chat model (#8405)
2024-10-04 10:36:39 +08:00
tool_chat_template_llama3.1_json.jinja
[Bugfix][Frontend] Update Llama Chat Templates to also support Non-Tool use (#10164)
2024-11-23 10:17:38 +08:00
tool_chat_template_llama3.2_json.jinja
[Misc] Update llama 3.2 template to support system prompt with images (#10901)
2024-12-05 05:54:06 +00:00
tool_chat_template_llama3.2_pythonic.jinja
[Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501)
2025-04-06 07:44:36 +00:00
tool_chat_template_llama4_json.jinja
Add chat template for Llama 4 models (#16428)
2025-04-24 20:19:36 +00:00
tool_chat_template_llama4_pythonic.jinja
[Frontend][Bug Fix] Update llama4 pythonic jinja template and llama4_pythonic parser (#17917)
2025-05-22 16:44:08 -07:00
tool_chat_template_mistral3.jinja
[Bugfix] Fix tool call template validation for Mistral models (#17644)
2025-05-08 09:47:19 +00:00
tool_chat_template_mistral_parallel.jinja
[Bugfix] example template should not add parallel_tool_prompt if tools is none (#9007)
2024-10-03 03:04:17 +00:00
tool_chat_template_mistral.jinja
[Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistral models (#5649)
2024-09-04 13:18:13 -07:00
tool_chat_template_muse_glimmer.jinja
Add Muse Glimmer model support (#51655)
2026-08-14 12:28:56 +08:00
tool_chat_template_phi4_mini.jinja
[Doc]: fixing typos to improve docs (#24480)
2025-09-08 23:06:04 -07:00
tool_chat_template_qwen3coder.jinja
[Bugfix]: Qwen3 Coder Tool Parser (#23099)
2025-08-26 19:58:32 -07:00
tool_chat_template_toolace.jinja
[Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501)
2025-04-06 07:44:36 +00:00
tool_chat_template_xlam_llama.jinja
Add xLAM tool parser support (#17148)
2025-06-19 14:26:41 +08:00
tool_chat_template_xlam_qwen.jinja
Add xLAM tool parser support (#17148)
2025-06-19 14:26:41 +08:00