Nicolò LucchesiandHarry Mellor 6f1e7f7226 [DisaggEverything] Tokens in<>out /generate endpoint (#24261) ...

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2025-11-14 09:58:01 -07:00

..

chart-helm

[Doc]: Make extraInit containers fully configurable in helm chart (#27497)

2025-11-06 20:27:16 +00:00

dashboards

[Bugfix] Fix incorrect kv cache metrics in grafana.json (#27133)

2025-10-22 20:58:36 -07:00

disaggregated_encoder

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233)

2025-11-11 18:58:33 -08:00

disaggregated_serving

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

disaggregated_serving_p2p_nccl_xpyd

[V0 Deprecation] Remove VLLM_USE_V1 from docs and scripts (#26336)

2025-10-07 16:46:44 +08:00

elastic_ep

[V0 Deprecation] Remove VLLM_USE_V1 from docs and scripts (#26336)

2025-10-07 16:46:44 +08:00

openai_embedding_long_text

Move PoolerConfig from config/__init__.py to config/pooler.py (#25181)

2025-09-19 11:02:55 +00:00

opentelemetry

[Docs] Fix syntax highlighting of shell commands (#19870)

2025-06-23 17:59:09 +00:00

pooling

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524)

2025-10-30 12:13:05 +00:00

prometheus_grafana

[Bugfix] Fix incorrect kv cache metrics in grafana.json (#27133)

2025-10-22 20:58:36 -07:00

structured_outputs

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

api_client.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

disaggregated_prefill.sh

Remove deprecated PyNcclConnector (#24151)

2025-09-03 22:49:16 +00:00

gradio_openai_chatbot_webserver.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

gradio_webserver.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

kv_events_subscriber.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

multi_instance_data_parallel.py

[Misc][DP] support customized aggregated logger for dp (#24354)

2025-10-13 17:45:59 -07:00

multi-node-serving.sh

correct LWS deployment yaml (#23104)

2025-09-02 12:04:59 +00:00

openai_chat_completion_client_for_multimodal.py

[chore] Move some wikimedia images to S3 (#28351)

2025-11-09 01:58:26 +00:00

openai_chat_completion_client_with_tools_required.py

[V0 Deprecation] Remove VLLM_USE_V1 from docs and scripts (#26336)

2025-10-07 16:46:44 +08:00

openai_chat_completion_client_with_tools_xlam_streaming.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

openai_chat_completion_client_with_tools_xlam.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

openai_chat_completion_client_with_tools.py

[Frontend] supports interleaved thinking (#28531)

2025-11-13 16:14:13 +08:00

openai_chat_completion_client.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

openai_chat_completion_tool_calls_with_reasoning.py

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

openai_chat_completion_with_reasoning_streaming.py

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

openai_chat_completion_with_reasoning.py

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

openai_completion_client.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

openai_responses_client_with_tools.py

[Frontend] OpenAI Responses API supports Tool/Function calling - non-harmony (#26874)

2025-11-06 10:40:03 +00:00

openai_transcription_client.py

[Docs] Update transcriptions API to use openai client with stream=True (#20271)

2025-07-01 15:47:13 +00:00

openai_translation_client.py

[Frontend] Add /v1/audio/translations OpenAI API endpoint (#19615)

2025-06-25 17:54:14 +00:00

prompt_embed_inference_with_openai_client.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

ray_serve_deepseek.py

[V0 Deprecation] Remove VLLM_USE_V1 from docs and scripts (#26336)

2025-10-07 16:46:44 +08:00

retrieval_augmented_generation_with_langchain.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

retrieval_augmented_generation_with_llamaindex.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

run_cluster.sh

Enhance run_cluster.sh for multi-NIC support (#28328)

2025-11-08 22:04:16 +00:00

sagemaker-entrypoint.sh

[CI/Build] Replace vllm.entrypoints.openai.api_server entrypoint with vllm serve command (#25967)

2025-10-02 10:04:57 -07:00

streamlit_openai_chatbot_webserver.py

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

token_generation_client.py

[DisaggEverything] Tokens in<>out /generate endpoint (#24261)

2025-11-14 09:58:01 -07:00

utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00