Logo
Explore Help
Sign In
iHore/vLLM
Watch 8
Star 0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
Files
45f92c00cf1752ae27b4e8a08a560abf08cc6cd2
vLLM/vllm/model_executor
T
History
bnellnm 5467ac3196 [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047)
2024-06-09 16:23:30 -04:00
..
guided_decoding
[Frontend][Core] Update Outlines Integration from FSM to Guide (#4109)
2024-06-05 16:49:12 -07:00
layers
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047)
2024-06-09 16:23:30 -04:00
model_loader
[Feature][Kernel] Support bitsandbytes quantization and QLoRA (#4776)
2024-06-01 14:51:10 -06:00
models
[Misc][Breaking] Change FP8 checkpoint format from act_scale -> input_scale (#5353)
2024-06-08 13:54:05 -04:00
__init__.py
[Core] Refactor Attention Take 2 (#3462)
2024-03-25 04:39:33 +00:00
custom_op.py
[Misc] Add CustomOp interface for device portability (#5255)
2024-06-05 09:18:19 -07:00
pooling_metadata.py
[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)
2024-05-11 11:30:37 -07:00
sampling_metadata.py
[Core] Avoid copying prompt/output tokens if no penalties are used (#5289)
2024-06-06 18:12:00 -07:00
utils.py
[Hardware][Neuron] Refactor neuron support (#3471)
2024-03-22 01:22:17 +00:00
Powered by Gitea Version: 1.27.2 Page: 108ms Template: 15ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API