6 people 111815d482 [Kernel] Support Fp8 Checkpoints (Dynamic + Static) (#4332) ...

Co-authored-by: Philipp Moritz <pcmoritz@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: mgoin <michael@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

2024-04-30 21:46:12 +00:00

..

guided_decoding

[mypy][5/N] Support all typing on model executor (#4427)

2024-04-28 19:01:26 -07:00

layers

[Kernel] Support Fp8 Checkpoints (Dynamic + Static) (#4332)

2024-04-30 21:46:12 +00:00

model_loader

[mypy][5/N] Support all typing on model executor (#4427)

2024-04-28 19:01:26 -07:00

models

[BugFix] Resolved Issues For LinearMethod --> QuantConfig (#4418)

2024-04-27 18:35:33 +00:00

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

sampling_metadata.py

[Core] Refactoring sampler and support prompt logprob for chunked prefill (#4309)

2024-04-26 13:02:02 +00:00

utils.py

[Hardware][Neuron] Refactor neuron support (#3471)

2024-03-22 01:22:17 +00:00