Woosuk Kwonandyoukaichao 56a8652f33 [Bugfix] store lock file in tmp directory (#3578)" (#3599) ...

Co-authored-by: youkaichao <youkaichao@126.com>

2024-03-24 20:06:50 -07:00

..

layers

[BugFix] tensor.get_device() -> tensor.device (#3604)

2024-03-24 19:01:13 -07:00

models

[BugFix] 1D query fix for MoE models (#3597)

2024-03-24 16:00:16 -07:00

parallel_utils

[BugFix] Some fixes for custom allreduce kernels (#2760)

2024-03-21 23:02:58 -07:00

__init__.py

[Hardware][Neuron] Refactor neuron support (#3471)

2024-03-22 01:22:17 +00:00

guided_decoding.py

Support arbitrary json_object in OpenAI and Context Free Grammar (#3211)

2024-03-16 13:35:27 -07:00

guided_logits_processors.py

Support arbitrary json_object in OpenAI and Context Free Grammar (#3211)

2024-03-16 13:35:27 -07:00

input_metadata.py

[Hardware][Neuron] Refactor neuron support (#3471)

2024-03-22 01:22:17 +00:00

model_loader.py

[Neuron] Support inference with transformers-neuronx (#2569)

2024-02-28 09:34:34 -08:00

neuron_model_loader.py

[Hardware][Neuron] Refactor neuron support (#3471)

2024-03-22 01:22:17 +00:00

sampling_metadata.py

[Hardware][Neuron] Refactor neuron support (#3471)

2024-03-22 01:22:17 +00:00

utils.py

[Hardware][Neuron] Refactor neuron support (#3471)

2024-03-22 01:22:17 +00:00

weight_utils.py

[Bugfix] store lock file in tmp directory (#3578)" (#3599)

2024-03-24 20:06:50 -07:00