3 people 560ef78bfe [Perf][Model Runner V2] Compact sampling masks on GPU instead of unpacking the full-vocab bitmask on CPU (#54901) ...

Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: vx120 <893600387@qq.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: vx120 <893600387@qq.com>

2026-09-03 19:03:36 -07:00

..

anthropic

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00

cohere

[Frontend] Gate scale-out endpoints behind opt-in flag (#54579)

2026-09-02 14:31:14 +08:00

generate

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00

launchers

[Frontend] Move engine/protocol.py out openai folder (#54492)

2026-08-31 10:13:50 +00:00

llm

[Misc] Use VLLMValidationError in offline inference input validation (#53432)

2026-08-23 08:43:51 -07:00

multimodal

[Feature][MM_UUIDs] Allow empty video URLs when using multi-modal UUIDs (#54220)

2026-09-01 05:55:27 +00:00

openai

[Rust Frontend] Report reasoning tokens in chat completion usage (#54883)

2026-09-03 16:47:24 -07:00

pooling

Use server-generated keys for late-interaction query caches (#51445)

2026-09-03 07:15:58 +00:00

scale_out

[Perf][Model Runner V2] Compact sampling masks on GPU instead of unpacking the full-vocab bitmask on CPU (#54901)

2026-09-03 19:03:36 -07:00

serve

[Bugfix][Security] Bound the validation-error response body (#54684)

2026-09-01 06:51:16 +00:00

speech_to_text

[Core] Add max_num_queued_reqs and max_num_queued_tokens for queue size management (#49445)

2026-08-31 14:26:49 +00:00

tool_parsers

[MyPy][1/N] Fix mypy errors in some tests/ directories and enforce follow-imports=silent (#49570)

2026-07-30 05:02:51 -07:00

unit_tests

[CI] Avoid logging test server environment values (#54379)

2026-09-03 17:00:29 -04:00

weight_transfer

[ROCm][CI] Solidify entrypoint LLM lifecycle (#51280)

2026-08-13 12:24:02 -05:00

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

conftest.py

Make bare hugging_face imports forbidden (#49726)

2026-07-25 04:18:39 -07:00