This website requires JavaScript.
Explore
Help
Sign In
iHore
/
vLLM
Watch
8
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
2
Packages
Projects
Releases
Wiki
Activity
Files
45f92c00cf1752ae27b4e8a08a560abf08cc6cd2
vLLM
/
vllm
/
model_executor
/
model_loader
T
History
chenqianfzh
b9c0605a8e
[Feature][Kernel] Support bitsandbytes quantization and QLoRA (
#4776
)
2024-06-01 14:51:10 -06:00
..
__init__.py
[Misc] Enhance attention selector (
#4751
)
2024-05-13 10:47:25 -07:00
loader.py
[Feature][Kernel] Support bitsandbytes quantization and QLoRA (
#4776
)
2024-06-01 14:51:10 -06:00
neuron.py
[Typing] Mypy typing part 2 (
#4043
)
2024-04-17 17:28:43 -07:00
tensorizer.py
[Frontend] [Core] perf: Automatically detect vLLM-tensorized model, update
tensorizer
to version 2.9.0 (
#4208
)
2024-05-13 14:57:07 -07:00
utils.py
[Kernel] FP8 support for MoE kernel / Mixtral (
#4244
)
2024-04-24 01:18:23 +00:00
weight_utils.py
[Feature][Kernel] Support bitsandbytes quantization and QLoRA (
#4776
)
2024-06-01 14:51:10 -06:00