halleriteandClaude Opus 4.7 cb600d1cdb [Frontend] Forward X-data-parallel-rank header on /inference/v1/generate (#42330) ...

Signed-off-by: hallerite <git@hallerite.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

2026-05-20 08:58:46 +00:00

..

cache

Support clear mm and encoder cache (#33452)

2026-01-31 15:22:25 +00:00

disagg

[Frontend] Forward X-data-parallel-rank header on /inference/v1/generate (#42330)

2026-05-20 08:58:46 +00:00

elastic_ep

[Refactor] [10/N] to simplify the vLLM openai completion serving architecture (#32369)

2026-01-15 07:41:34 +00:00

instrumentator

[Frontend] Add GPU-less render serving path (vllm launch render) (#36166)

2026-03-08 16:35:09 +01:00

lora

[LoRA] Support 2D and 3D MoE LoRA adapter at the same time (#42242)

2026-05-18 15:22:26 +08:00

profile

[Cleanup] Refactor profiling env vars into a CLI config (#29912)

2025-12-09 13:29:33 -05:00

render

[Bugfix] Account for truncate_prompt_tokens when computing max_tokens (#41800)

2026-05-06 16:10:17 +00:00

rlhf

[feat] Add explicit /start_weight_update and /finish_weight_update APIs for weight transfer (#39212)

2026-05-08 18:03:33 -07:00

rpc

[Refactor] [4/N] Move VLLM_SERVER_DEV endpoints into the serve directory (#30749)

2025-12-17 02:27:30 -08:00

sleep

[Frontend][Misc] Remove unused log in /is_sleeping (#37093)

2026-03-16 17:46:28 +08:00

tokenize

[Bugfix] Use dedicated MM processor cache in /tokenize to prevent sender-cache pollution (#38545)

2026-04-01 21:14:49 -07:00

__init__.py

[Frontend][CI] Consolidate instrumentator entrypoints (#34123)

2026-02-10 07:30:19 +00:00