Zhuohan Li 2f8844ba08 Re-enable the 80 char line width limit (#3305)

2024-03-10 19:49:14 -07:00

..

configs

Re-enable the 80 char line width limit (#3305)

2024-03-10 19:49:14 -07:00

tokenizers

Re-enable the 80 char line width limit (#3305)

2024-03-10 19:49:14 -07:00

__init__.py

[Tokenizer] Add an option to specify tokenizer (#284)

2023-06-28 09:46:58 -07:00

config.py

Support starcoder2 architecture (#3089)

2024-02-29 00:51:48 -08:00

tokenizer.py

[BugFix] Fix get tokenizer when using ray (#3301)

2024-03-10 19:17:16 -07:00