Robert Shaw 4ea1f9678d [BugFix] Resolved Issues For LinearMethod --> QuantConfig (#4418)

2024-04-27 18:35:33 +00:00

..

guided_decoding

[Bugfix] Add fix for JSON whitespace (#4189)

2024-04-19 20:49:22 -07:00

layers

[BugFix] Fix min_tokens when eos_token_id is None (#4389)

2024-04-27 09:52:46 -07:00

model_loader

[Core] Support offline use of local cache for models (#4374)

2024-04-27 09:59:55 -07:00

models

[BugFix] Resolved Issues For LinearMethod --> QuantConfig (#4418)

2024-04-27 18:35:33 +00:00

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

sampling_metadata.py

[Core] Refactoring sampler and support prompt logprob for chunked prefill (#4309)

2024-04-26 13:02:02 +00:00

utils.py

[Hardware][Neuron] Refactor neuron support (#3471)

2024-03-22 01:22:17 +00:00