youkaichao 18b296fdb2 [core] remove beam search from the core (#9105)

2024-10-07 05:47:04 +00:00

..

tool_parsers

[Bugfix] fix tool_parser error handling when serve a model not support it (#8709)

2024-10-06 12:51:08 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Frontend][Feature] support tool calling for internlm/internlm2_5-7b-chat model (#8405)

2024-10-04 10:36:39 +08:00

cli_args.py

[Frontend][Feature] support tool calling for internlm/internlm2_5-7b-chat model (#8405)

2024-10-04 10:36:39 +08:00

logits_processors.py

[mypy] Enable following imports for entrypoints (#7248)

2024-08-20 23:28:21 -07:00

protocol.py

[core] remove beam search from the core (#9105)

2024-10-07 05:47:04 +00:00

run_batch.py

[Core] Support Lora lineage and base model metadata management (#6315)

2024-09-20 06:20:56 +00:00

serving_chat.py

[Bugfix] fix tool_parser error handling when serve a model not support it (#8709)

2024-10-06 12:51:08 +00:00

serving_completion.py

[Frontend] API support for beam search (#9087)

2024-10-05 23:39:03 -07:00

serving_embedding.py

Adds truncate_prompt_tokens param for embeddings creation (#8999)

2024-10-04 18:31:40 +00:00

serving_engine.py

[Frontend] API support for beam search (#9087)

2024-10-05 23:39:03 -07:00

serving_tokenization.py

[Frontend] Added support for HF's new continue_final_message parameter (#8942)

2024-09-29 17:59:47 +00:00