This website requires JavaScript.
Explore
Help
Sign In
iHore
/
vLLM
Watch
8
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
Files
62b8aebc6f06b5c8fafa1f27893cd4f9bb11fa8b
vLLM
/
vllm
/
model_executor
/
layers
/
quantization
T
History
Noam Gat
cc74b2b232
Updating lm-format-enforcer version and adding links to decoding libraries in docs (
#4222
)
2024-04-20 08:33:16 +00:00
..
__init__.py
[Kernel][FP8] Initial support with dynamic per-tensor scaling (
#4118
)
2024-04-20 04:28:57 +00:00
awq.py
[Core] Set
linear_weights
directly on the layer (
#3977
)
2024-04-11 16:35:51 -04:00
base_config.py
Add AWQ support for all models (
#1714
)
2023-11-18 17:56:47 -08:00
fp8.py
Updating lm-format-enforcer version and adding links to decoding libraries in docs (
#4222
)
2024-04-20 08:33:16 +00:00
gptq.py
[Core] Set
linear_weights
directly on the layer (
#3977
)
2024-04-11 16:35:51 -04:00
marlin.py
[Core] Set
linear_weights
directly on the layer (
#3977
)
2024-04-11 16:35:51 -04:00
schema.py
Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (
#3290
)
2024-04-03 14:15:55 -07:00
squeezellm.py
[Core] Set
linear_weights
directly on the layer (
#3977
)
2024-04-11 16:35:51 -04:00