This website requires JavaScript.
Explore
Help
Sign In
iHore
/
vLLM
Watch
8
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
Files
27949354faa06035645aa908cc73922500a80b17
vLLM
/
vllm
/
model_executor
T
History
Alex Kogan
and
Michael Goin
27949354fa
[Feature] A calibration-free RTN-based quantization for accurate and accelerated INT4/INT8 inference (
#18768
)
...
Signed-off-by: Alex Kogan <
alex.kogan@oracle.com
> Co-authored-by: Michael Goin <
mgoin64@gmail.com
>
2025-07-01 05:44:38 +00:00
..
guided_decoding
[Misc] Add SPDX-FileCopyrightText (
#19100
)
2025-06-03 11:20:17 -07:00
layers
[Feature] A calibration-free RTN-based quantization for accurate and accelerated INT4/INT8 inference (
#18768
)
2025-07-01 05:44:38 +00:00
model_loader
[Quantization] Improve BitsAndBytesModelLoader (
#20242
)
2025-06-30 18:22:09 +08:00
models
[Core] [Bugfix] [Multimodal] Fix multimodal profiling and generation for SFT/PTQed models (
#20058
)
2025-06-30 17:26:49 +00:00
__init__.py
[Misc] Add SPDX-FileCopyrightText (
#19100
)
2025-06-03 11:20:17 -07:00
custom_op.py
[Fix][torch.compile] Enable custom ops by default when Inductor off (
#20102
)
2025-06-27 09:00:42 -06:00
parameter.py
[Misc] Add SPDX-FileCopyrightText (
#19100
)
2025-06-03 11:20:17 -07:00
pooling_metadata.py
[Misc] Add SPDX-FileCopyrightText (
#19100
)
2025-06-03 11:20:17 -07:00
sampling_metadata.py
[Misc] Add SPDX-FileCopyrightText (
#19100
)
2025-06-03 11:20:17 -07:00
utils.py
[Misc] Add SPDX-FileCopyrightText (
#19100
)
2025-06-03 11:20:17 -07:00