vLLM/vllm/model_executor at bf2ddc6610094524a61e90441e579d502c7dee06 - vLLM - iHore Software Repository

iHore/vLLM

Files

T

History

Luka GovedičandDaniël de Kok bf2ddc6610 [bugfix] Fix static asymmetric quantization case (#10334 )

Signed-off-by: Daniël de Kok <me@danieldk.eu>
Signed-off-by: luka <luka@neuralmagic.com>
Co-authored-by: Daniël de Kok <me@danieldk.eu>

2024-11-15 09:35:11 +08:00

..

guided_decoding

[Frontend] Bad words sampling parameter (#9717 )

2024-10-26 16:29:38 +00:00

[bugfix] Fix static asymmetric quantization case (#10334 )

2024-11-15 09:35:11 +08:00

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

[Bugfix] Fix unable to load some models (#10312 )

2024-11-14 16:55:54 -08:00

__init__.py

[Performance] Optimize e2e overheads: Reduce python allocations (#7162 )

2024-08-08 21:34:28 -07:00

custom_op.py

[Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143 )

2024-11-06 01:09:10 -08:00

parameter.py

[Kernel] (2/N) Machete - Integrate into CompressedTensorsWNA16 and GPTQMarlin (#7701 )

2024-09-23 13:46:26 -04:00

pooling_metadata.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734 )

2024-05-11 11:30:37 -07:00

sampling_metadata.py

[Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143 )

2024-11-06 01:09:10 -08:00

utils.py

[Hardware] using current_platform.seed_everything (#9785 )

2024-10-29 14:47:44 +00:00