Robert ShawandZifei Tong 7ed6a4f0e1 [ BugFix ] Prompt Logprobs Detokenization (#6223) ...

Co-authored-by: Zifei Tong <zifeitong@gmail.com>

2024-07-11 22:02:29 +00:00

..

configs

[Speculative Decoding] Medusa Implementation with Top-1 proposer (#4978)

2024-07-09 18:34:02 -07:00

tokenizer_group

[Bugfix] Use RayActorError for older versions of Ray in RayTokenizerGroupPool (#6039)

2024-07-01 20:12:40 +00:00

tokenizers

[Mypy] Part 3 fix typing for nested directories for most of directory (#4161)

2024-04-22 21:32:44 -07:00

__init__.py

[Tokenizer] Add an option to specify tokenizer (#284)

2023-06-28 09:46:58 -07:00

config.py

[Speculative Decoding] Medusa Implementation with Top-1 proposer (#4978)

2024-07-09 18:34:02 -07:00

detokenizer.py

[ BugFix ] Prompt Logprobs Detokenization (#6223)

2024-07-11 22:02:29 +00:00

image_processor.py

[Core] Dynamic image size support for VLMs (#5276)

2024-07-02 20:34:00 -07:00

tokenizer.py

[Misc] centralize all usage of environment variables (#4548)

2024-05-02 11:13:25 -07:00