5 people 90531daf6d [Core][Frontend] Bind KV-event publishers at port 0 and expose the bound endpoints (#55844) ...

Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: mukeshbhandarkar <shell00035@gmail.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>

2026-09-18 18:11:05 -07:00

..

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

conftest.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_abort_final_step.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_admission_control.py

[Core] Make parallel sampling (n>1) reqs admission atomic (#53936)

2026-09-18 18:08:44 +02:00

test_async_llm.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_core_engine_actor_manager.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_dp_placement_node_allowlist.py

[Core][Engine] allow DP ray placement groups to be set on specific nodes (#44669)

2026-06-05 20:07:47 +00:00

test_engine_args.py

Promote prefix_cache_retention_interval to an argument and change the default to 0 (#52216)

2026-08-17 13:20:50 +00:00

test_engine_core_client.py

[Core][Frontend] Bind KV-event publishers at port 0 and expose the bound endpoints (#55844)

2026-09-18 18:11:05 -07:00

test_engine_core.py

[Frontend][Core] Add release_kv_cache_memory() API (#44890)

2026-09-18 07:12:12 +08:00

test_fast_incdec_prefix_err.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_init_error_messaging.py

[Bugfix][Core] Reserve the KV null block when validating max_model_len (#47272)

2026-08-20 02:49:23 +00:00

test_input_processor_trace_replay.py

[Core][V1] Support trace_decode_token_ids for deterministic decode replay (#46701)

2026-08-20 15:12:43 +08:00

test_iteration_logging.py

[Refactor] Move iteration logging to the frontend (#46647)

2026-07-15 17:59:05 -07:00

test_kv_cache_group_metadata.py

[Bugfix] Restore KV cache metadata GET method for external event consumer (#56925)

2026-09-17 23:01:35 +00:00

test_llm_engine_finalizer_is_weak.py

[Bugfix][MRV2] Release model and KV cache on in-process engine shutdown (#54162)

2026-08-28 22:09:08 -07:00

test_llm_engine.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_logprobs_processor.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_output_processor.py

[CI/Build][Hardware][NVIDIA] Add Rubin CUDA 13.4 nightly images (#55953)

2026-09-17 08:05:31 -07:00

test_parallel_sampling.py

feat(frontend): session id plumbing into requests (#48048)

2026-08-03 22:18:58 +00:00

test_preprocess_error_handling.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_startup_watch_processes.py

[ROCm] Give EngineCore cleanup grace after request abort (#52281)

2026-08-19 11:39:59 -05:00

utils.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00