4 people 11ba93f364 [BugFix] Use file:// rendezvous for single-node executors to eliminate startup port races (#50999) ...

Signed-off-by: Parsa Mazaheri <p_mazaheri@apple.com>
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Parsa Mazaheri <p_mazaheri@apple.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>

2026-08-09 22:00:04 -04:00

..

cpu

[CPU] Fix torch.compile crash from torch.accelerator.synchronize on CPU-only hosts (#49960)

2026-08-03 19:48:48 +08:00

gpu

[Bugfix][MRV2] Reserve spec-decode lookahead blocks in V2 warmup (#51438)

2026-08-08 23:58:43 +00:00

sentinel

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[Bugfix] Universally align block table width to 128 tokens (#50302)

2026-07-31 08:52:17 -07:00

cp_utils.py

[Core] Add MRV2 virtual-batch PCP for MLA (#46570)

2026-07-19 02:53:15 +00:00

cpu_model_runner.py

[CPU] Fix torch.compile crash from torch.accelerator.synchronize on CPU-only hosts (#49960)

2026-08-03 19:48:48 +08:00

cpu_worker.py

[BugFix] Use file:// rendezvous for single-node executors to eliminate startup port races (#50999)

2026-08-09 22:00:04 -04:00

dp_utils.py

[Perf][1/n] Eliminate various GPU<->CPU syncs (#41429)

2026-05-11 20:36:03 +00:00

ec_connector_model_runner_mixin.py

[Refactor] Remove dead code in kv connector and model runner (#38383)

2026-03-31 17:05:23 -04:00

encoder_cudagraph_defs.py

[1/N] Unify multiple-path encoder cuda graph support (#49934)

2026-08-02 10:33:23 +08:00

encoder_cudagraph.py

[1/N] Unify multiple-path encoder cuda graph support (#49934)

2026-08-02 10:33:23 +08:00

gpu_input_batch.py

[Kernel] ReplaySSM: cache SSM inputs for faster Mamba2 standard decode (#48018)

2026-07-24 09:39:49 -07:00

gpu_model_runner.py

Bump Flashinfer version to 0.6.16.post3 (#50892)

2026-08-09 00:54:07 -07:00

gpu_ubatch_wrapper.py

[Bugfix] Fix UBatchWrapper CUDA graph key to sum all ubatches, not just first two (#43161)

2026-07-07 12:42:31 +00:00

gpu_worker.py

[Bugfix] Fix level-2 sleep/wake/reload with enable_lora=True (#39935)

2026-08-06 09:13:10 +08:00

kv_connector_model_runner_mixin.py

[Bugfix][KVConnector] Disable cross-layer KV blocks for per-token-head quant (#49226)

2026-07-26 05:24:27 +03:00

lora_model_runner_mixin.py

[Bugfix] Fix level-2 sleep/wake/reload with enable_lora=True (#39935)

2026-08-06 09:13:10 +08:00

mamba_utils.py

[Bugfix][Hybrid] Fix cross-block race on num_accepted in MRv2 align prefix cache (#50432)

2026-08-03 22:54:24 +00:00

startup_plan.py

[Core] Persist and reuse the memory-profiling result across boots (opt-in) (#47388)

2026-07-08 00:53:02 +00:00

tpu_input_batch.py

[Refactor] Remove dead code in multiple files (#49745)

2026-07-27 15:58:26 -04:00

ubatch_utils.py

[BugFix] Preserve max_seq_len in ubatch metadata during CUDA graph capture (#40961)

2026-05-05 04:29:34 +00:00

ubatching.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

utils.py

[Bugfix] Fix packed KV block zeroing stride (#50276)

2026-08-06 13:49:06 -07:00

worker_base.py

Stop setting CUDA_VISIBLE_DEVICES internally in vLLM, add device_ids arg (#45026)

2026-06-20 13:38:10 -07:00

workspace.py

[Bugfix] Fix workspace resize leaking reserved GPU memory (#39226)

2026-04-23 20:50:05 +00:00

xpu_model_runner.py

[XPU] Alias is_current_stream_capturing to XPU in cuda wrapper (#50526)

2026-08-05 15:10:17 +08:00

xpu_worker.py

[Doc] Fix grammatically incorrect error message in gpu_worker and xpu_worker (#36715)

2026-07-07 17:03:06 +00:00