Wentao Ye 995dea1354 [Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139) ...

Signed-off-by: yewentao256 <zhyanwentao@126.com>

2026-03-29 18:12:50 +00:00

..

__init__.py

Support embedding models in V1 (#16188)

2025-06-18 21:36:33 -07:00

late_interaction.py

[Perf] Optimize compute maxsim using batched version, 3.2% E2E throughput improvement (#36710)

2026-03-12 08:37:01 +08:00

metadata.py

[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139)

2026-03-29 18:12:50 +00:00