Harry Mellor c6798baa9c Change top_k to be disabled with 0 (still accept -1 for now) (#17773) ...

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2025-05-09 10:01:49 +00:00

..

__init__.py

…

cache_engine.py

Allocate kv_cache with stride order (#16605)

2025-04-25 22:03:31 -07:00

cpu_enc_dec_model_runner.py

[Chore] Remove Sampler from Model Code (#17084)

2025-04-24 02:49:33 -07:00

cpu_model_runner.py

[Core] Remove legacy input mapper/processor from V0 (#15686)

2025-04-28 15:38:48 +08:00

cpu_pooling_model_runner.py

…

cpu_worker.py

[CPU][Bugfix] Using custom allreduce for CPU backend (#15934)

2025-04-02 07:46:47 -07:00

enc_dec_model_runner.py

[Core] [Bugfix] Add Input Embeddings (#15428)

2025-05-02 01:06:39 -07:00

hpu_model_runner.py

[Hardware][Intel-Gaudi] Support Automatic Prefix Caching on HPU (#17648)

2025-05-07 22:37:03 -07:00

hpu_worker.py

Add full API docs and improve the UX of navigating them (#17485)

2025-05-03 19:42:43 -07:00

model_runner_base.py

…

model_runner.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

multi_step_hpu_worker.py

[Hardware][Intel-Gaudi] Multi-step scheduling implementation for HPU (#12779)

2025-04-11 07:38:36 -07:00

multi_step_model_runner.py

Add full API docs and improve the UX of navigating them (#17485)

2025-05-03 19:42:43 -07:00

multi_step_neuron_model_runner.py

Add NeuronxDistributedInference support, Speculative Decoding, Dynamic on-device sampling (#16357)

2025-05-07 00:07:30 -07:00

multi_step_neuronx_distributed_model_runner.py

Add NeuronxDistributedInference support, Speculative Decoding, Dynamic on-device sampling (#16357)

2025-05-07 00:07:30 -07:00

multi_step_tpu_worker.py

…

multi_step_worker.py

…

neuron_model_runner.py

Change top_k to be disabled with 0 (still accept -1 for now) (#17773)

2025-05-09 10:01:49 +00:00

neuron_worker.py

Add NeuronxDistributedInference support, Speculative Decoding, Dynamic on-device sampling (#16357)

2025-05-07 00:07:30 -07:00

neuronx_distributed_model_runner.py

Add NeuronxDistributedInference support, Speculative Decoding, Dynamic on-device sampling (#16357)

2025-05-07 00:07:30 -07:00

pooling_model_runner.py

[Core] [Bugfix] Add Input Embeddings (#15428)

2025-05-02 01:06:39 -07:00

tpu_model_runner.py

Change top_k to be disabled with 0 (still accept -1 for now) (#17773)

2025-05-09 10:01:49 +00:00

tpu_worker.py

[Hardware][TPU][V1] Multi-LoRA implementation for the V1 TPU backend (#14238)

2025-05-07 16:28:47 -04:00

utils.py

…

worker_base.py

…

worker.py

Add full API docs and improve the UX of navigating them (#17485)

2025-05-03 19:42:43 -07:00

xpu_model_runner.py

[Core] Remove legacy input mapper/processor from V0 (#15686)

2025-04-28 15:38:48 +08:00

xpu_worker.py

Add full API docs and improve the UX of navigating them (#17485)

2025-05-03 19:42:43 -07:00