Fred Reiss c9f09a4fe8 [mypy] Fix mypy warnings in api_server.py (#11941) ...

Signed-off-by: Fred Reiss <frreiss@us.ibm.com>

2025-01-11 01:04:58 +00:00

..

tool_parsers

[Model] IBM Granite 3.1 (#11307)

2024-12-19 11:27:24 +08:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[mypy] Fix mypy warnings in api_server.py (#11941)

2025-01-11 01:04:58 +00:00

cli_args.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00

logits_processors.py

[Bugfix] using len(tokenizer) instead of tokenizer.vocab_size in AllowedTokenIdsLogitsProcessor (#11156)

2024-12-13 15:56:19 +00:00

protocol.py

[Frontend] Online Pooling API (#11457)

2024-12-24 17:54:30 +08:00

run_batch.py

[Bugfix] Validate lora adapters to avoid crashing server (#11727)

2025-01-10 15:56:36 +08:00

serving_chat.py

[Frontend] Improve StreamingResponse Exception Handling (#11752)

2025-01-05 16:35:01 -05:00

serving_completion.py

[Frontend] Improve StreamingResponse Exception Handling (#11752)

2025-01-05 16:35:01 -05:00

serving_embedding.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00

serving_engine.py

treat do_lower_case in the same way as the sentence-transformers library (#11815)

2025-01-09 11:05:43 +08:00

serving_models.py

[Bugfix] Validate lora adapters to avoid crashing server (#11727)

2025-01-10 15:56:36 +08:00

serving_pooling.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00

serving_score.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00

serving_tokenization.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00