Boyuan FengandHarry Mellor 94e6b2d55f Allow users to specify kv cache memory size (#21489) ...

Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2025-09-11 13:41:07 +00:00

..

__init__.py

Allow users to specify kv cache memory size (#21489)

2025-09-11 13:41:07 +00:00

deep_gemm.py

[Log] Use Debug Once for DeepGEMM E8M0 When not Enabled (#23858)

2025-08-28 22:18:10 +00:00

flashinfer.py

[Kernel] Added flashinfer fp8 per-tensor gemms (#22895)

2025-08-26 06:54:04 -07:00

jsontree.py

Adds json_count_leaves utility function (#23899)

2025-08-29 05:28:13 -07:00

tensor_schema.py

[Bugfix] Fix MiniCPMV Image input inference failed (#22813)

2025-08-13 09:41:41 -07:00