Woosuk Kwon 2f8b4ce0c0 [Model Runner V2] Do not initialize sampler for non-last PP ranks (#36824) ...

Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>

2026-03-12 03:55:28 +00:00

..

__init__.py

[Model Runner V2] Support pooling models (#35120)

2026-02-27 18:03:01 -08:00

late_interaction_runner.py

[Perf] Optimize compute maxsim using batched version, 3.2% E2E throughput improvement (#36710)

2026-03-12 08:37:01 +08:00

pooling_runner.py

[Model Runner V2] Do not initialize sampler for non-last PP ranks (#36824)

2026-03-12 03:55:28 +00:00