Harry Mellor 4b2ed7926a Improve configs - the rest! (#17562) ...

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2025-05-09 15:18:44 -07:00

..

__init__.py

Add NeuronxDistributedInference support, Speculative Decoding, Dynamic on-device sampling (#16357)

2025-05-07 00:07:30 -07:00

cpu.py

[Misc] Auto fallback to float16 for pre-Ampere GPUs when detected bfloat16 config (#17265)

2025-05-09 17:16:12 +00:00

cuda.py

[Misc] Auto fallback to float16 for pre-Ampere GPUs when detected bfloat16 config (#17265)

2025-05-09 17:16:12 +00:00

hpu.py

[Hardware][Intel-Gaudi] Multi-step scheduling implementation for HPU (#12779)

2025-04-11 07:38:36 -07:00

interface.py

[Misc] Auto fallback to float16 for pre-Ampere GPUs when detected bfloat16 config (#17265)

2025-05-09 17:16:12 +00:00

neuron.py

Add NeuronxDistributedInference support, Speculative Decoding, Dynamic on-device sampling (#16357)

2025-05-07 00:07:30 -07:00

rocm.py

[FEAT][ROCm]: Support AITER MLA on V1 Engine (#17523)

2025-05-09 10:42:05 +08:00

tpu.py

Improve configs - the rest! (#17562)

2025-05-09 15:18:44 -07:00

xpu.py

[Hardware] add platform-specific request validation api (#16291)

2025-04-09 12:50:01 -07:00