This website requires JavaScript.
Explore
Help
Sign In
iHore
/
vLLM
Watch
8
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
Files
a008629807b45c2b015d4e0bc7c4186cecbb642f
vLLM
/
vllm
/
model_executor
/
model_loader
T
History
Dipika Sikka
and
Michael Goin
5884c2b454
[Misc] Update to comply with the new
compressed-tensors
config (
#5350
)
...
Co-authored-by: Michael Goin <
michael@neuralmagic.com
>
2024-06-10 03:49:46 +00:00
..
__init__.py
[Misc] Enhance attention selector (
#4751
)
2024-05-13 10:47:25 -07:00
loader.py
[Feature][Kernel] Support bitsandbytes quantization and QLoRA (
#4776
)
2024-06-01 14:51:10 -06:00
neuron.py
[Typing] Mypy typing part 2 (
#4043
)
2024-04-17 17:28:43 -07:00
tensorizer.py
[Frontend] [Core] perf: Automatically detect vLLM-tensorized model, update
tensorizer
to version 2.9.0 (
#4208
)
2024-05-13 14:57:07 -07:00
utils.py
[Kernel] FP8 support for MoE kernel / Mixtral (
#4244
)
2024-04-24 01:18:23 +00:00
weight_utils.py
[Misc] Update to comply with the new
compressed-tensors
config (
#5350
)
2024-06-10 03:49:46 +00:00