Logo
Explore Help
Sign In
iHore/vLLM
Watch 8
Star 0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
Files
9364f74eee2e8aab9e3c9cd6dea290018ef43b95
vLLM/vllm/model_executor
T
History
Robert Shaw 9364f74eee [ Kernel ] Enable fp8-marlin for fbgemm-fp8 models (#6606)
2024-07-20 18:50:10 +00:00
..
guided_decoding
[Bugfix] use diskcache in outlines _get_guide #5436 (#6203)
2024-07-08 11:23:24 -07:00
layers
[ Kernel ] Enable fp8-marlin for fbgemm-fp8 models (#6606)
2024-07-20 18:50:10 +00:00
model_loader
[misc][distributed] add seed to dummy weights (#6491)
2024-07-16 19:16:34 -07:00
models
[Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA, add partially supported model notes (#6543)
2024-07-20 09:39:07 -07:00
__init__.py
[Core] Refactor Attention Take 2 (#3462)
2024-03-25 04:39:33 +00:00
custom_op.py
[Hardware][Intel GPU] Add Intel GPU(XPU) inference backend (#3814)
2024-06-17 11:01:25 -07:00
pooling_metadata.py
[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)
2024-05-11 11:30:37 -07:00
sampling_metadata.py
[Misc] Consolidate and optimize logic for building padded tensors (#6541)
2024-07-20 04:17:24 +00:00
utils.py
[Hardware][Neuron] Refactor neuron support (#3471)
2024-03-22 01:22:17 +00:00
Powered by Gitea Version: 1.27.2 Page: 115ms Template: 7ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API