Schwinn Saereesitthipitak b5b61c622c [Core][Distributed] Add process-checkpoint lifecycle hooks for communicators (starting with Flashinfer) (#46877) ...

Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>

2026-07-26 14:47:50 -04:00

..

__init__.py

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

async_llm.py

[Core][Distributed] Add process-checkpoint lifecycle hooks for communicators (starting with Flashinfer) (#46877)

2026-07-26 14:47:50 -04:00

coordinator.py

[UX] Increase DP Coordinator startup timeout from 30s to 120s (#42343)

2026-05-28 03:31:45 -07:00

core_client.py

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

core.py

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

detokenizer.py

[Bugfix][Spec Decode] Select earliest-completing stop string in check_stop_strings (#49391)

2026-07-23 18:14:06 +08:00

exceptions.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

input_processor.py

[BugFix] Fix blocked reasoning parsing with MRV2 (#43808)

2026-05-28 04:59:34 +00:00

llm_engine.py

[Bugfix][V1] Clean up compiled-model bytecode hooks on VllmRunner exit (#45195)

2026-06-16 20:31:17 -07:00

logprobs.py

[Model Runner V2] Add logprob_token_ids support (#40559)

2026-05-01 10:02:03 -07:00

output_processor.py

[Front-end] [Messages] Populate num_cache_creation_tokens (#48535)

2026-07-18 13:04:35 -04:00

parallel_sampling.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

tensor_ipc.py

Add tensor IPC transfer mechanism for multimodal data (#32104)

2026-03-21 20:10:20 +00:00

utils.py

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00