Julien Denize c6187f55f7 Refactor MistralTokenizer (#26358) ...

Signed-off-by: Julien Denize <julien.denize@mistral.ai>

2025-10-09 22:48:58 +00:00

..

chat_templates

Remove all references to yapf as it's no longer used (#26251)

2025-10-05 09:18:11 -07:00

configs

[Model] Lfm2Moe (#26344)

2025-10-07 16:03:05 +00:00

processors

[Model] Use merge_by_field_config for MM models (Ovis family) (#26308)

2025-10-07 12:54:22 +00:00

tokenizers

Refactor MistralTokenizer (#26358)

2025-10-09 22:48:58 +00:00

__init__.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

config_parser_base.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

config.py

[Feature] Enable E8M0 by Default on Hopper for DeepGEMM, 5% E2E throughput improvement (#26197)

2025-10-08 15:33:56 +08:00

detokenizer_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

dynamic_module.py

[Docs] Enable fail_on_warning for the docs build in CI (#25580)

2025-09-24 19:30:33 +00:00

processor.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

runai_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

s3_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

tokenizer_base.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

tokenizer.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00