Patrick von Platen 0535e5fe6c Fix edge case Mistral tokenizer (#10152)

2024-11-08 15:42:27 +00:00

..

configs

[CI/Build] drop support for Python 3.8 EOL (#8464)

2024-11-06 07:11:55 +00:00

tokenizer_group

Adds method to read the pooling types from model's files (#9506)

2024-11-07 08:42:40 +00:00

tokenizers

Fix edge case Mistral tokenizer (#10152)

2024-11-08 15:42:27 +00:00

__init__.py

Fix the log to correct guide user to install modelscope (#9793)

2024-10-29 10:36:59 -07:00

config.py

Adds method to read the pooling types from model's files (#9506)

2024-11-07 08:42:40 +00:00

detokenizer_utils.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

detokenizer.py

[Bugfix] fix detokenizer shallow copy (#5919)

2024-10-22 15:38:12 -07:00

processor.py

[Model] Support Pixtral models in the HF Transformers format (#9036)

2024-10-18 13:29:56 -06:00

tokenizer.py

[Bugfix][Frontend] Guard against bad token ids (#9634)

2024-10-29 14:13:20 -07:00

utils.py

[Core][Bugfix] Accept GGUF model without .gguf extension (#8056)

2024-09-02 08:43:26 -04:00