Mor ZusmanandMor Zusman 9ad32dacd9 [BugFix][Model] Jamba - Handle aborted requests, Add tests and fix cleanup bug (#6425) ...

Co-authored-by: Mor Zusman <morz@ai21.com>

2024-07-16 01:32:55 +00:00

..

__init__.py

[vlm] Remove vision language config. (#6089)

2024-07-03 22:14:16 +00:00

loader.py

[BugFix][Model] Jamba - Handle aborted requests, Add tests and fix cleanup bug (#6425)

2024-07-16 01:32:55 +00:00

neuron.py

[Typing] Mypy typing part 2 (#4043)

2024-04-17 17:28:43 -07:00

openvino.py

[Hardware][Intel] OpenVINO vLLM backend (#5379)

2024-06-28 13:50:16 +00:00

tensorizer.py

[Frontend] Add FlexibleArgumentParser to support both underscore and dash in names (#5718)

2024-06-20 17:00:13 -06:00

utils.py

[Kernel] FP8 support for MoE kernel / Mixtral (#4244)

2024-04-24 01:18:23 +00:00

weight_utils.py

[ Misc ] Enable Quantizing All Layers of DeekSeekv2 (#6423)

2024-07-14 21:38:42 +00:00