[Rust Frontend] Add support for truncate_prompt_tokens and truncation_side (#48584)

Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: pranavthakur0-0 <pranavthakurdew@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
This commit is contained in:
Pranav Thakur
2026-08-29 00:16:37 +00:00
committed by GitHub
co-authored by Bugen Zhao
parent 1a16c2ad2c
commit 085e9bb07e
17 changed files with 424 additions and 35 deletions
+1
View File
@@ -195,6 +195,7 @@ impl ChatRequestProcessor {
sampling_params: request.sampling_params,
decode_options: request.decode_options,
intermediate: request.intermediate,
prompt_truncation: request.prompt_truncation,
priority: request.priority,
cache_salt: request.cache_salt,
add_special_tokens: request.add_special_tokens,