From 3a79957b62ade336010cc052e322d0005eb091a2 Mon Sep 17 00:00:00 2001 From: Emmanuel Acheampong Date: Mon, 10 Aug 2026 03:31:34 -0700 Subject: [PATCH] [Doc] Add Crusoe Managed Inference deployment guide (#49353) Signed-off-by: Emmanuel Acheampong --- docs/deployment/frameworks/crusoe.md | 64 ++++++++++++++++++++++++++++ 1 file changed, 64 insertions(+) create mode 100644 docs/deployment/frameworks/crusoe.md diff --git a/docs/deployment/frameworks/crusoe.md b/docs/deployment/frameworks/crusoe.md new file mode 100644 index 0000000000..0babd1c925 --- /dev/null +++ b/docs/deployment/frameworks/crusoe.md @@ -0,0 +1,64 @@ +# Crusoe + +[Crusoe](https://crusoe.ai/) provides Managed Inference, an OpenAI-compatible API for open-weight models, powered by vLLM. Because the service speaks the OpenAI API, code written against a self-hosted vLLM server works against Crusoe endpoints without changes. + +## Prerequisites + +- A Crusoe account +- An Inference API key, created in the [Crusoe Console](https://console.crusoe.ai/) under **Security > Inference API Key** + +Set the key as an environment variable: + +```bash +export CRUSOE_API_KEY="your-api-key" +``` + +## Using the OpenAI SDK + +Point the OpenAI client at the Crusoe endpoint: + +```python +import os + +from openai import OpenAI + +client = OpenAI( + base_url="https://api.inference.crusoecloud.com/v1", + api_key=os.environ["CRUSOE_API_KEY"], +) + +response = client.chat.completions.create( + model="zai/GLM-5.2", + messages=[{"role": "user", "content": "Hello, how are you?"}], +) + +print(response.choices[0].message.content) +``` + +## Verifying with curl + +!!! console "Command" + + ```bash + curl https://api.inference.crusoecloud.com/v1/chat/completions \ + -H "Authorization: Bearer $CRUSOE_API_KEY" \ + -H "Content-Type: application/json" \ + -d '{ + "model": "zai/GLM-5.2", + "messages": [ + {"role": "user", "content": "Hello, how are you?"} + ], + "max_tokens": 50 + }' + ``` + +## Available models + +List the current model catalog: + +```bash +curl https://api.inference.crusoecloud.com/v1/models \ + -H "Authorization: Bearer $CRUSOE_API_KEY" +``` + +For the full list of available models and API details, see the [Crusoe Managed Inference docs](https://docs.crusoecloud.com/managed-inference/overview).