[Docs] Fix broken anchor links in serving/pooling/MoE docs (#49654)

Signed-off-by: euisuh <euisuh.jeong@gmail.com>
This commit is contained in:
Euisuh Jeong
2026-07-24 02:42:56 +00:00
committed by GitHub
parent 1479bd9e9d
commit da54a5bf05
4 changed files with 7 additions and 7 deletions
+1 -1
View File
@@ -242,4 +242,4 @@ See [Fused MoE Kernel features](./moe_kernel_features.md#fused-moe-modular-all2a
## FusedMoEExpertsModular ## FusedMoEExpertsModular
See [Fused MoE Kernel features](./moe_kernel_features.md#fused-moe-experts-kernels) for a list of all the available modular experts. See [Fused MoE Kernel features](./moe_kernel_features.md#fused-experts-kernels) for a list of all the available modular experts.
+1 -1
View File
@@ -184,7 +184,7 @@ Our online Server provides endpoints that correspond to the offline APIs:
- [Classification API](classify.md#online-serving)(`/classify`) - [Classification API](classify.md#online-serving)(`/classify`)
- Corresponding to `LLM.score`: - Corresponding to `LLM.score`:
- [Score API](scoring.md#score-api) (`/score`, `/v1/score`) - [Score API](scoring.md#score-api) (`/score`, `/v1/score`)
- [Cohere Rerank API](scoring.md#rerank-api) (`/rerank`, `/v1/rerank`, `/v2/rerank`) - [Cohere Rerank API](scoring.md#cohere-rerank-api) (`/rerank`, `/v1/rerank`, `/v2/rerank`)
- Pooling API (`/pooling`) is similar to `LLM.encode`, being applicable to all types of pooling models. - Pooling API (`/pooling`) is similar to `LLM.encode`, being applicable to all types of pooling models.
The following introduces the Pooling API. For other APIs, please refer to the link above. The following introduces the Pooling API. For other APIs, please refer to the link above.
+1 -1
View File
@@ -20,7 +20,7 @@ The score models is designed to compute similarity scores between two input prom
- `LLM.score` - `LLM.score`
- Online APIs: - Online APIs:
- [Score API](scoring.md#score-api) (`/score`, `/v1/score`) - [Score API](scoring.md#score-api) (`/score`, `/v1/score`)
- [Cohere Rerank API](scoring.md#rerank-api) (`/rerank`, `/v1/rerank`, `/v2/rerank`) - [Cohere Rerank API](scoring.md#cohere-rerank-api) (`/rerank`, `/v1/rerank`, `/v2/rerank`)
!!! note !!! note
Only when a classification model outputs num_labels equal to 1 can it be used as a scoring model and have its scoring API enabled. Only when a classification model outputs num_labels equal to 1 can it be used as a scoring model and have its scoring API enabled.
+4 -4
View File
@@ -10,7 +10,7 @@ We currently support the following OpenAI APIs:
- Only applicable to [text generation models](../../models/generative_models.md). - Only applicable to [text generation models](../../models/generative_models.md).
- *Note: `suffix` parameter is not supported.* - *Note: `suffix` parameter is not supported.*
- [Chat Completions API](./openai_compatible_server.md#chat-api) (`/v1/chat/completions`) - [Chat Completions API](./openai_compatible_server.md#chat-api) (`/v1/chat/completions`)
- Only applicable to [text generation models](../../models/generative_models.md) with a [chat template](./openai_compatible_server.md#chat-template). - Only applicable to [text generation models](../../models/generative_models.md) with a [chat template](#chat-template).
- *Note: `user` parameter is ignored.* - *Note: `user` parameter is ignored.*
- *Note:* Setting the `parallel_tool_calls` parameter to `false` ensures vLLM only returns zero or one tool call per request. Setting it to `true` (the default) allows returning more than one tool call per request. There is no guarantee more than one tool call will be returned if this is set to `true`, as that behavior is model dependent and not all models are designed to support parallel tool calls. - *Note:* Setting the `parallel_tool_calls` parameter to `false` ensures vLLM only returns zero or one tool call per request. Setting it to `true` (the default) allows returning more than one tool call per request. There is no guarantee more than one tool call will be returned if this is set to `true`, as that behavior is model dependent and not all models are designed to support parallel tool calls.
- [Chat Completions batch API](./openai_compatible_server.md#chat-api) (`/v1/chat/completions/batch`) - [Chat Completions batch API](./openai_compatible_server.md#chat-api) (`/v1/chat/completions/batch`)
@@ -32,7 +32,7 @@ We currently support the following OpenAI APIs:
- [Cohere Embed API](../../models/pooling_models/embed.md#cohere-embed-api) (`/v2/embed`) - [Cohere Embed API](../../models/pooling_models/embed.md#cohere-embed-api) (`/v2/embed`)
- Compatible with [Cohere's Embed API](https://docs.cohere.com/reference/embed) - Compatible with [Cohere's Embed API](https://docs.cohere.com/reference/embed)
- Works with any [embedding model](../../models/pooling_models/embed.md#supported-models), including multimodal models. - Works with any [embedding model](../../models/pooling_models/embed.md#supported-models), including multimodal models.
- [Cohere Rerank API](../../models/pooling_models/scoring.md#rerank-api) (`/rerank`, `/v1/rerank`, `/v2/rerank`) - [Cohere Rerank API](../../models/pooling_models/scoring.md#cohere-rerank-api) (`/rerank`, `/v1/rerank`, `/v2/rerank`)
- Implements [Jina AI's v1 rerank API](https://jina.ai/reranker/) - Implements [Jina AI's v1 rerank API](https://jina.ai/reranker/)
- compatible with [Cohere's v1 & v2 rerank APIs](https://docs.cohere.com/v2/reference/rerank) - compatible with [Cohere's v1 & v2 rerank APIs](https://docs.cohere.com/v2/reference/rerank)
@@ -49,7 +49,7 @@ For further details on pooling models, please refer to [this page](../../models/
- Only applicable to [embedding models](../../models/pooling_models/embed.md). - Only applicable to [embedding models](../../models/pooling_models/embed.md).
- [Scoring Usages](../../models/pooling_models/scoring.md) - [Scoring Usages](../../models/pooling_models/scoring.md)
- [Score API](../../models/pooling_models/scoring.md#score-api) (`/score`, `/v1/score`) - [Score API](../../models/pooling_models/scoring.md#score-api) (`/score`, `/v1/score`)
- [Cohere Rerank API](../../models/pooling_models/scoring.md#rerank-api) (`/rerank`, `/v1/rerank`, `/v2/rerank`) - [Cohere Rerank API](../../models/pooling_models/scoring.md#cohere-rerank-api) (`/rerank`, `/v1/rerank`, `/v2/rerank`)
- Applicable to [score models](../../models/pooling_models/scoring.md) (cross-encoder, bi-encoder, late-interaction). - Applicable to [score models](../../models/pooling_models/scoring.md) (cross-encoder, bi-encoder, late-interaction).
- [Pooling API](../../models/pooling_models/README.md#pooling-api) (`/pooling`) - [Pooling API](../../models/pooling_models/README.md#pooling-api) (`/pooling`)
- Applicable to all [pooling models](../../models/pooling_models/README.md). - Applicable to all [pooling models](../../models/pooling_models/README.md).
@@ -73,7 +73,7 @@ For further details on speech to text, please refer to [this page](speech_to_tex
- Applicable to [score models](../../models/pooling_models/scoring.md) (cross-encoder, bi-encoder, late-interaction). - Applicable to [score models](../../models/pooling_models/scoring.md) (cross-encoder, bi-encoder, late-interaction).
- [Pooling API](../../models/pooling_models/README.md#pooling-api) (`/pooling`) - [Pooling API](../../models/pooling_models/README.md#pooling-api) (`/pooling`)
- Applicable to all [pooling models](../../models/pooling_models/README.md). - Applicable to all [pooling models](../../models/pooling_models/README.md).
- [Generative Scoring API](generative_scoring.md#generative-scoring-api) (`/generative_scoring`) - [Generative Scoring API](generative_scoring.md) (`/generative_scoring`)
- Applicable to [CausalLM models](../../models/generative_models.md) (task `"generate"`). - Applicable to [CausalLM models](../../models/generative_models.md) (task `"generate"`).
- Computes next-token probabilities for specified `label_token_ids`. - Computes next-token probabilities for specified `label_token_ids`.