Logo
Explore Help
Sign In
iHore/vLLM
Watch 8
Star 0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
Files
ae4e280602f3c91d322a449f33f5aebbdd59ccc1
vLLM/vllm/tokenizers
T
History
Nick Hill a96197f564 [Perf] Simplify DeepseekV32 tokenizer, ensure fast detokenization used (#33855)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
2026-02-08 07:16:34 +00:00
..
__init__.py
[Chore][1/2] Drop v0.14 deprecations (#31285)
2025-12-24 09:54:01 -08:00
deepseek_v32_encoding.py
Remove deprecated reasoning_content message field (#33402)
2026-01-30 11:48:15 +00:00
deepseek_v32.py
[Perf] Simplify DeepseekV32 tokenizer, ensure fast detokenization used (#33855)
2026-02-08 07:16:34 +00:00
detokenizer_utils.py
[Bugfix] Fix DeepSeek v3.2 tokenizer outputting None issue (#33832)
2026-02-05 23:50:49 +00:00
grok2.py
feat(frontend): early-fail tokenization guard for user requests (#31366)
2026-02-05 19:38:02 -08:00
hf.py
feat(frontend): early-fail tokenization guard for user requests (#31366)
2026-02-05 19:38:02 -08:00
mistral.py
feat(frontend): early-fail tokenization guard for user requests (#31366)
2026-02-05 19:38:02 -08:00
protocol.py
feat(frontend): early-fail tokenization guard for user requests (#31366)
2026-02-05 19:38:02 -08:00
registry.py
Improve Mistral format checks. (#33253)
2026-01-30 06:23:33 -08:00
Powered by Gitea Version: 1.27.2 Page: 141ms Template: 6ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API