3 people 3facf822b7 [Performance] Load HF tokenizers and processors from a local snapshot (#60825) ...

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>

2026-10-12 13:45:54 +00:00

..

__init__.py

[Bugfix] Fix RuntimeError: Already borrowed by adding thread-safe Hugging Face fast-tokenizer wrappers (#41181)

2026-05-05 14:04:01 +00:00

deepseek_v4_encoding.py

[Bugfix][Multimodal] Preserve DeepSeek V4 image block spacing (#56882)

2026-09-18 18:44:39 +08:00

deepseek_v4.py

[Misc] mv chat_utils.py to renderers. (#60522)

2026-10-10 06:50:34 +00:00

deepseek_v32_encoding.py

[Bugfix] Return HTTP 400 instead of 501 for unknown chat roles in DeepSeek encoders (#53071)

2026-08-20 09:23:41 +00:00

deepseek_v32.py

[Misc] mv chat_utils.py to renderers. (#60522)

2026-10-10 06:50:34 +00:00

deepseek_v41_encoding.py

[Bugfix][Frontend][Rust Frontend] Update DeepSeek V4.1 Flash reasoning effort mappings (#58316)

2026-09-26 02:18:58 +00:00

deepseek_v41.py

[Misc] mv chat_utils.py to renderers. (#60522)

2026-10-10 06:50:34 +00:00

detokenizer_utils.py

[Perf] Reduce fallback decode CPU by 69% at 32K (#60497)

2026-10-08 21:42:56 +00:00

fastokens.py

Deprecated 1st generation Qwen and QwenVL models (#45131)

2026-06-10 14:55:33 +00:00

hf.py

[Bugfix][Tokenizer] Fix off-by-one max_token_id from vocab_size (#59491)

2026-10-01 05:43:30 +00:00

kimi_audio.py

[Misc] mv chat_utils.py to renderers. (#60522)

2026-10-10 06:50:34 +00:00

mistral.py

[Refactor] Remove dead code multiple places (#60120)

2026-10-10 15:41:10 +00:00

protocol.py

[Misc] mv chat_utils.py to renderers. (#60522)

2026-10-10 06:50:34 +00:00

registry.py

[Performance] Load HF tokenizers and processors from a local snapshot (#60825)

2026-10-12 13:45:54 +00:00