Jee Li d6f4bd7cdd [Misc]Add customized information for models (#4132)

2024-04-30 21:18:14 -07:00

..

guided_decoding

Allow user to define whitespace pattern for outlines (#4305)

2024-04-30 20:48:39 -07:00

layers

[Misc]Add customized information for models (#4132)

2024-04-30 21:18:14 -07:00

model_loader

[Frontend] [Core] Tensorizer: support dynamic num_readers, update version (#4467)

2024-04-30 16:32:13 -07:00

models

[BugFix] Resolved Issues For LinearMethod --> QuantConfig (#4418)

2024-04-27 18:35:33 +00:00

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

sampling_metadata.py

[Core] Refactoring sampler and support prompt logprob for chunked prefill (#4309)

2024-04-26 13:02:02 +00:00

utils.py

[Hardware][Neuron] Refactor neuron support (#3471)

2024-03-22 01:22:17 +00:00