Nick Hill a96197f564 [Perf] Simplify DeepseekV32 tokenizer, ensure fast detokenization used (#33855) ...

Signed-off-by: Nick Hill <nickhill123@gmail.com>

2026-02-08 07:16:34 +00:00

..

inputs

[Renderer] Define render_cmpl and render_chat (#34039)

2026-02-07 05:24:40 -08:00

__init__.py

[Refactor] Make Renderer an abstract class (#33479)

2026-02-01 10:36:30 +08:00

deepseek_v32.py

[Perf] Simplify DeepseekV32 tokenizer, ensure fast detokenization used (#33855)

2026-02-08 07:16:34 +00:00

embed_utils.py

[Frontend] Use new Renderer for Completions and Tokenize API (#32863)

2026-01-31 04:51:15 -08:00

grok2.py

[Refactor] Consolidate sequence normalization and enc-dec parsing (#33928)

2026-02-06 15:43:47 +00:00

hf.py

[Refactor] Consolidate sequence normalization and enc-dec parsing (#33928)

2026-02-06 15:43:47 +00:00

mistral.py

[Refactor] Consolidate sequence normalization and enc-dec parsing (#33928)

2026-02-06 15:43:47 +00:00

params.py

feat(frontend): early-fail tokenization guard for user requests (#31366)

2026-02-05 19:38:02 -08:00

protocol.py

[Renderer] Define render_cmpl and render_chat (#34039)

2026-02-07 05:24:40 -08:00

registry.py

[Refactor] Make Renderer an abstract class (#33479)

2026-02-01 10:36:30 +08:00

terratorch.py

[Refactor] Consolidate sequence normalization and enc-dec parsing (#33928)

2026-02-06 15:43:47 +00:00