halleriteandClaude Opus 4.7 97c4317bf5 [Bugfix][Frontend] Default max_tokens server-side on /inference/v1/generate (#42329) ...

Signed-off-by: hallerite <git@hallerite.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

2026-05-13 11:16:46 +02:00

..

cache

Support clear mm and encoder cache (#33452)

2026-01-31 15:22:25 +00:00

disagg

[Bugfix][Frontend] Default max_tokens server-side on /inference/v1/generate (#42329)

2026-05-13 11:16:46 +02:00

elastic_ep

[Refactor] [10/N] to simplify the vLLM openai completion serving architecture (#32369)

2026-01-15 07:41:34 +00:00

instrumentator

[Frontend] Add GPU-less render serving path (vllm launch render) (#36166)

2026-03-08 16:35:09 +01:00

lora

[Feat] allow inplace loading lora (#31326)

2026-01-20 10:15:20 +08:00

profile

[Cleanup] Refactor profiling env vars into a CLI config (#29912)

2025-12-09 13:29:33 -05:00

render

[Bugfix] Account for truncate_prompt_tokens when computing max_tokens (#41800)

2026-05-06 16:10:17 +00:00

rlhf

[feat] Add explicit /start_weight_update and /finish_weight_update APIs for weight transfer (#39212)

2026-05-08 18:03:33 -07:00

rpc

[Refactor] [4/N] Move VLLM_SERVER_DEV endpoints into the serve directory (#30749)

2025-12-17 02:27:30 -08:00

sleep

[Frontend][Misc] Remove unused log in /is_sleeping (#37093)

2026-03-16 17:46:28 +08:00

tokenize

[Bugfix] Use dedicated MM processor cache in /tokenize to prevent sender-cache pollution (#38545)

2026-04-01 21:14:49 -07:00

__init__.py

[Frontend][CI] Consolidate instrumentator entrypoints (#34123)

2026-02-10 07:30:19 +00:00