Chenyaaang 87baebebd8 [Frontend][TPU] Add TPU default max-num-batched-tokens based on device name (#17508) ...

Signed-off-by: Chenyaaang <chenyangli@google.com>

2025-05-02 21:42:44 -07:00

..

__init__.py

Remove openvino support in favor of external plugin (#15339)

2025-03-22 14:06:39 -07:00

cpu.py

[Hardware] add platform-specific request validation api (#16291)

2025-04-09 12:50:01 -07:00

cuda.py

[MISC] Use string annotation types for class definitions (#17244)

2025-04-27 08:39:57 +00:00

hpu.py

[Hardware][Intel-Gaudi] Multi-step scheduling implementation for HPU (#12779)

2025-04-11 07:38:36 -07:00

interface.py

[Misc] Minor typo/grammar in platforms/interface.py (#17307)

2025-04-28 05:45:42 -07:00

neuron.py

Improve configs - CacheConfig (#16835)

2025-04-20 12:25:04 +08:00

rocm.py

[Hardware][AMD] Improve OAM device ID + llama4 Maverick MOE tuning (#16263)

2025-05-02 19:44:19 +00:00

tpu.py

[Frontend][TPU] Add TPU default max-num-batched-tokens based on device name (#17508)

2025-05-02 21:42:44 -07:00

xpu.py

[Hardware] add platform-specific request validation api (#16291)

2025-04-09 12:50:01 -07:00