[Model] Support Cloudflare/clef-omni on /v1/systemone (#61064)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com> Signed-off-by: Isotr0py <Isotr0py@outlook.com> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com> Co-authored-by: Isotr0py <Isotr0py@outlook.com>
This commit is contained in:
co-authored by
Claude Opus 5.5
Isotr0py
parent
314ab8cffd
commit
092c35dd15
@@ -130,6 +130,32 @@ the request lists them, a `noul` labels its options `yes` and `no`, and a
|
||||
| options per `choice` | 26 |
|
||||
| levels per `score` | 10 |
|
||||
|
||||
## Clef-Omni
|
||||
|
||||
[Clef-Omni](https://huggingface.co/Cloudflare/clef-omni) is a decision model:
|
||||
a joint schema head on the Qwen3-Omni thinker scores every option of every
|
||||
question in one forward pass. vLLM serves it as a pooling model.
|
||||
|
||||
```bash
|
||||
vllm serve Cloudflare/clef-omni
|
||||
```
|
||||
|
||||
- A request is one read. The prompt is the one the checkpoint's
|
||||
`joint_schema_model.py` builds: the state, then every question with its
|
||||
options. A JSON state is written as compact JSON with sorted keys.
|
||||
- A state too long for the model is truncated to fit, as the reference does.
|
||||
A request whose questions alone exceed 64,000 tokens, or `max_model_len`,
|
||||
returns 400.
|
||||
- `instructions` returns 400, since the prompt is fixed. `chat_template_kwargs`
|
||||
has no effect.
|
||||
- There are no labels, so `label_mass` is 1 and `confidence` is the chosen
|
||||
option's probability. `usage.input_tokens` counts the prompt once, and
|
||||
`output_tokens` is 0.
|
||||
- `images`, `audio` and `videos` are read as the reference does: placed
|
||||
before the state, videos sampled at 2 fps, and a video's soundtrack heard
|
||||
with it when every video has one. Audio clips cannot be sent together with
|
||||
videos that have soundtracks.
|
||||
|
||||
## Request fields
|
||||
|
||||
| field | meaning |
|
||||
@@ -139,6 +165,7 @@ the request lists them, a `noul` labels its options `yes` and `no`, and a
|
||||
| `instructions` | optional context placed ahead of the questions |
|
||||
| `chat_template_kwargs` | passed to the chat template, for example `{"enable_thinking": false}` |
|
||||
| `cache_salt` | optional [prefix-cache salt](../../usage/security.md#cache-salting) applied to every question |
|
||||
| `images`, `audio`, `videos` | optional media URLs or data URLs, for models that take them ([Clef-Omni](#clef-omni)) |
|
||||
|
||||
A question with any field other than `type`, `instructions` and `criteria` is
|
||||
rejected with a 400.
|
||||
|
||||
Reference in New Issue
Block a user