3 people 3e6e33526d [Disagg] return routed_experts on streaming generate responses (#44638) ...

Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

2026-06-21 07:37:10 -07:00

..

anthropic

[Frontend] Report cache usage in Anthropic /v1/messages API (#40912)

2026-06-20 21:12:48 +00:00

cli

[Rust Frontend] Support hybrid/external DP LB in Python supervised bootstrap (#45805)

2026-06-17 07:32:40 +00:00

generate

[Core] Support structured outputs for beam search (#35022)

2026-06-12 06:56:25 -07:00

mcp

[Refactor] Deprecate ResponsesParser wrapper, inline parsing into ParsableContext (#45431)

2026-06-12 16:15:41 -04:00

openai

[Render] Add reasoning/tool parsing to /derender + fix byte-fallback FFFD (#45919)

2026-06-20 19:43:32 -04:00

pooling

[Misc] Validate Cohere Embed Mixed Content Payloads (#45873)

2026-06-17 06:57:12 +00:00

serve

[Disagg] return routed_experts on streaming generate responses (#44638)

2026-06-21 07:37:10 -07:00

speech_to_text

(security) Enforce audio upload size limit before full file materialization (#45510)

2026-06-15 10:25:24 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

chat_utils.py

[CI] Stabilize the multi-audio OpenAI server path (#44051)

2026-06-07 15:54:32 +08:00

grpc_server.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

launcher.py

[Logs Refactor] Optimize shutdown logs, easier to follow and consistent (#43707)

2026-06-04 14:36:32 -04:00

llm.py

Revert "Fix Stale Encoder Cache After Weight Update" (#46125)

2026-06-20 07:09:09 -07:00

offline_utils.py

[Frontend] Split the offline inference APIs and utils. (#43553)

2026-05-26 05:20:24 +00:00