Kiran Randroy bc0c0192d1 [Bugfix] Enable Proper attention_bias Usage in Llama Model Configuration (#3767) ...

Co-authored-by: roy <jasonailu87@gmail.com>

2024-04-08 19:42:35 +00:00

..

layers

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

models

[Bugfix] Enable Proper attention_bias Usage in Llama Model Configuration (#3767)

2024-04-08 19:42:35 +00:00

parallel_utils

[Core] improve robustness of pynccl (#3860)

2024-04-04 16:52:12 -07:00

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

guided_decoding.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

guided_logits_processors.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

model_loader.py

Usage Stats Collection (#2852)

2024-03-28 22:16:12 -07:00

neuron_model_loader.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

sampling_metadata.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

utils.py

[Hardware][Neuron] Refactor neuron support (#3471)

2024-03-22 01:22:17 +00:00

weight_utils.py

[Core] Enable hf_transfer by default if available (#3817)

2024-04-04 04:02:43 +00:00