Woosuk Kwon cb40b3ab6b [Kernel] Add MoE Triton kernel configs for A100 40GB (#3700)

2024-03-28 15:26:24 -07:00

..

layers

[Kernel] Add MoE Triton kernel configs for A100 40GB (#3700)

2024-03-28 15:26:24 -07:00

models

[Model] Add support for Qwen2MoeModel (#3346)

2024-03-28 15:19:59 +00:00

parallel_utils

[Core] Support multi-node inference(eager and cuda graph) (#3686)

2024-03-28 15:01:55 -07:00

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

guided_decoding.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

guided_logits_processors.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

model_loader.py

[Feature] Add vision language model support. (#3042)

2024-03-25 14:16:30 -07:00

neuron_model_loader.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

sampling_metadata.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

utils.py

[Hardware][Neuron] Refactor neuron support (#3471)

2024-03-22 01:22:17 +00:00

weight_utils.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00