[Model] Support Cloudflare/clef-omni on /v1/systemone (#61064)

Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
This commit is contained in:
Jiangyun Zhu
2026-10-12 21:27:34 +08:00
committed by GitHub
co-authored by Claude Opus 5.5 Isotr0py
parent 314ab8cffd
commit 092c35dd15
20 changed files with 1592 additions and 69 deletions
@@ -130,6 +130,32 @@ the request lists them, a `noul` labels its options `yes` and `no`, and a
| options per `choice` | 26 |
| levels per `score` | 10 |
## Clef-Omni
[Clef-Omni](https://huggingface.co/Cloudflare/clef-omni) is a decision model:
a joint schema head on the Qwen3-Omni thinker scores every option of every
question in one forward pass. vLLM serves it as a pooling model.
```bash
vllm serve Cloudflare/clef-omni
```
- A request is one read. The prompt is the one the checkpoint's
`joint_schema_model.py` builds: the state, then every question with its
options. A JSON state is written as compact JSON with sorted keys.
- A state too long for the model is truncated to fit, as the reference does.
A request whose questions alone exceed 64,000 tokens, or `max_model_len`,
returns 400.
- `instructions` returns 400, since the prompt is fixed. `chat_template_kwargs`
has no effect.
- There are no labels, so `label_mass` is 1 and `confidence` is the chosen
option's probability. `usage.input_tokens` counts the prompt once, and
`output_tokens` is 0.
- `images`, `audio` and `videos` are read as the reference does: placed
before the state, videos sampled at 2 fps, and a video's soundtrack heard
with it when every video has one. Audio clips cannot be sent together with
videos that have soundtracks.
## Request fields
| field | meaning |
@@ -139,6 +165,7 @@ the request lists them, a `noul` labels its options `yes` and `no`, and a
| `instructions` | optional context placed ahead of the questions |
| `chat_template_kwargs` | passed to the chat template, for example `{"enable_thinking": false}` |
| `cache_salt` | optional [prefix-cache salt](../../usage/security.md#cache-salting) applied to every question |
| `images`, `audio`, `videos` | optional media URLs or data URLs, for models that take them ([Clef-Omni](#clef-omni)) |
A question with any field other than `type`, `instructions` and `criteria` is
rejected with a 400.