[Model] Add Clef-Flash support (#61308)
Signed-off-by: Tianyu Guo <guoty@inferact.ai> Signed-off-by: Isotr0py <Isotr0py@outlook.com> Co-authored-by: Codex <noreply@openai.com> Co-authored-by: Isotr0py <Isotr0py@outlook.com>
This commit is contained in:
co-authored by
Codex
Isotr0py
parent
0d2689e0df
commit
380638afbb
@@ -130,6 +130,30 @@ the request lists them, a `noul` labels its options `yes` and `no`, and a
|
||||
| options per `choice` | 26 |
|
||||
| levels per `score` | 10 |
|
||||
|
||||
## Clef-Flash
|
||||
|
||||
[Clef-Flash](https://huggingface.co/Cloudflare/clef-flash) uses a Qwen3.5-9B
|
||||
backbone and a joint schema head to score all questions in one forward pass.
|
||||
vLLM detects the head and serves the checkpoint as a pooling model.
|
||||
|
||||
```bash
|
||||
vllm serve Cloudflare/clef-flash --max-model-len 16384
|
||||
```
|
||||
|
||||
Send requests to `/v1/systemone` using `state` and `questions`, as in the
|
||||
examples above. `choice`, `noul` and `score` questions are supported.
|
||||
|
||||
- Text and JSON states use the checkpoint's fixed prompt. JSON is compact
|
||||
with sorted keys. `instructions` returns 400; `chat_template_kwargs`
|
||||
has no effect.
|
||||
- The state is truncated to fit 16,384 tokens, or `max_model_len` if smaller.
|
||||
A schema that exceeds this bound returns 400.
|
||||
- `images` and `videos` are placed before the state. Videos are sampled at
|
||||
2 fps and processed by the Qwen3.5 vision processor. Audio inputs return
|
||||
400, and video soundtracks are ignored.
|
||||
- Each request performs one pooling read. `usage.input_tokens` counts the
|
||||
prompt once, `output_tokens` is 0, and `label_mass` is 1.
|
||||
|
||||
## Clef-Omni
|
||||
|
||||
[Clef-Omni](https://huggingface.co/Cloudflare/clef-omni) is a decision model:
|
||||
@@ -188,7 +212,7 @@ vllm serve LiquidAI/d1-3B
|
||||
| `instructions` | optional context placed ahead of the questions |
|
||||
| `chat_template_kwargs` | passed to the chat template, for example `{"enable_thinking": false}` |
|
||||
| `cache_salt` | optional [prefix-cache salt](../../usage/security.md#cache-salting) applied to every question |
|
||||
| `images`, `audio`, `videos` | optional media URLs or data URLs, for models that take them ([Clef-Omni](#clef-omni), [Liquid d1](#liquid-d1), images only) |
|
||||
| `images`, `audio`, `videos` | optional media URLs or data URLs, for models that take them ([Clef-Flash](#clef-flash), images/video; [Clef-Omni](#clef-omni); [Liquid d1](#liquid-d1), images only) |
|
||||
|
||||
A question with any field other than `type`, `instructions` and `criteria` is
|
||||
rejected with a 400.
|
||||
|
||||
Reference in New Issue
Block a user