Woosuk Kwon 0fca3cdcf2 [Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

..

__init__.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

loader.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

neuron.py

[Typing] Mypy typing part 2 (#4043)

2024-04-17 17:28:43 -07:00

tensorizer.py

[Core] Fix circular reference which leaked llm instance in local dev env (#4737)

2024-05-10 23:54:32 +09:00

utils.py

[Kernel] FP8 support for MoE kernel / Mixtral (#4244)

2024-04-24 01:18:23 +00:00

weight_utils.py

[Core] Support offline use of local cache for models (#4374)

2024-04-27 09:59:55 -07:00