3 people 9b0c4bab36 [Kernel] Triton Configs for Fp8 Block Quantization (#11589) ...

Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>

2025-01-30 11:53:22 -08:00

..

guided_decoding

[bugfix] catch xgrammar unsupported array constraints (#12210)

2025-01-20 16:42:02 -08:00

layers

[Kernel] Triton Configs for Fp8 Block Quantization (#11589)

2025-01-30 11:53:22 -08:00

model_loader

[Hardware][NV] Fix Modelopt model loading for k-v-scales for Llama models. (#11787)

2025-01-29 01:46:12 -08:00

models

[Hardware][NV] Fix Modelopt model loading for k-v-scales for Llama models. (#11787)

2025-01-29 01:46:12 -08:00

__init__.py

[Performance] Optimize e2e overheads: Reduce python allocations (#7162)

2024-08-08 21:34:28 -07:00

custom_op.py

[platform] support pytorch custom op pluggable (#11328)

2025-01-10 10:02:38 +00:00

parameter.py

[Misc][Quark] Upstream Quark format to VLLM (#10765)

2025-01-15 11:05:15 -05:00

pooling_metadata.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

sampling_metadata.py

Update pre-commit hooks (#12475)

2025-01-27 17:23:08 -07:00

utils.py

[platforms] enable platform plugins (#11602)

2024-12-30 20:24:45 +08:00