3 people e9be5323f0 [Perf] Integrate flash-maxsim Triton kernels for late-interaction scoring (#40337) ...

Signed-off-by: roi.pony <roi.pony@ibm.com>
Co-authored-by: roi.pony <roi.pony@ibm.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>

2026-10-01 14:06:43 -04:00

..

cpu

[MRV2] Buffer util simplifications (#56888)

2026-09-15 20:36:51 +00:00

gpu

[Perf] Integrate flash-maxsim Triton kernels for late-interaction scoring (#40337)

2026-10-01 14:06:43 -04:00

sentinel

[Bugfix][FT] Pass stateless process-group timeouts explicitly (#58611)

2026-09-29 03:14:02 +00:00

__init__.py

…

block_table.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

cp_utils.py

[PCP][DCP] Support DCP target model with non-DCP Dspark (#56723)

2026-09-26 18:12:35 -04:00

cpu_model_runner.py

[Feature] Triton kernel dispatcher (#43048)

2026-09-25 04:07:43 +00:00

cpu_worker.py

[Profiler] Unify platform-aware torch profiling (#57460)

2026-09-20 19:17:23 -07:00

dp_utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

ec_connector_model_runner_mixin.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

encoder_cudagraph_defs.py

[MM][CG] Enable encoder CUDA Graph for MiniCPM-V (#42785)

2026-09-10 06:28:48 +00:00

encoder_cudagraph.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

gpu_input_batch.py

[Bugfix] V1: clear stale allowed_token_ids mask in InputBatch.condense (#43931)

2026-09-27 03:44:54 +00:00

gpu_model_runner.py

[Core] Remove deprecated mamba_cache_mode "all" (#58997)

2026-10-01 02:59:37 -07:00

gpu_ubatch_wrapper.py

[Core] Model console logging as CLI configuration (#57205)

2026-09-25 11:36:59 +01:00

gpu_worker.py

[Model Runner V2] Support randomized dummy inputs (#58411)

2026-10-01 00:52:26 -07:00

kv_connector_model_runner_mixin.py

[Bugfix][KVConnector] Finalize saves on steps without a forward (#57775)

2026-09-25 00:06:36 +00:00

lora_model_runner_mixin.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

mamba_utils.py

[Core] Remove deprecated mamba_cache_mode "all" (#58997)

2026-10-01 02:59:37 -07:00

mm_encoder_model_runner.py

[Bugfix][MRV2] Match fast-prefill padding to active LoRA batches (#56456)

2026-09-18 22:13:23 +00:00

startup_plan.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

ubatch_utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

ubatching.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

utils.py

[Fast Start] Charge daemon-held weights against gpu_memory_utilization (#57298)

2026-09-29 17:58:35 +00:00

worker_base.py

[Feature] Triton kernel dispatcher (#43048)

2026-09-25 04:07:43 +00:00

workspace.py

[Core][Kernel] Share persistent workspaces for Marlin and Humming (#57421)

2026-09-20 17:28:33 +08:00

xpu_model_runner.py

[XPU] Use encoder-only model runner for EC producer instances (#59320)

2026-09-30 13:43:21 +08:00

xpu_worker.py

[Refactor] Share workspace and model runner init between GPU and XPU workers (#59200)

2026-09-30 14:29:12 +00:00