Patrick von Platen b4e4eda92e [Bugfix][Core] Fix tekken edge case for mistral tokenizer (#8640)

2024-09-20 14:33:03 -07:00

..

configs

[Model] Support Solar Model (#8386)

2024-09-18 11:04:00 -06:00

tokenizer_group

[mypy] Misc. typing improvements (#7417)

2024-08-13 09:20:20 +08:00

tokenizers

[Bugfix][Core] Fix tekken edge case for mistral tokenizer (#8640)

2024-09-20 14:33:03 -07:00

__init__.py

[Tokenizer] Add an option to specify tokenizer (#284)

2023-06-28 09:46:58 -07:00

config.py

[Model] Support Solar Model (#8386)

2024-09-18 11:04:00 -06:00

detokenizer.py

[Model] Add Mistral Tokenization to improve robustness and chat encoding (#7739)

2024-08-27 12:40:02 +00:00

image_processor.py

[model] Support for Llava-Next-Video model (#7559)

2024-09-10 22:21:36 -07:00

processor.py

[Model][VLM] Add Qwen2-VL model support (#7905)

2024-09-11 09:31:19 -07:00

tokenizer.py

[Core][Bugfix] Accept GGUF model without .gguf extension (#8056)

2024-09-02 08:43:26 -04:00

utils.py

[Core][Bugfix] Accept GGUF model without .gguf extension (#8056)

2024-09-02 08:43:26 -04:00