Martin Hickey 0a31372e5f [Frontend] Add detokenization streaming derender for disaggregated serving (#47301) ...

Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>

2026-07-29 18:01:20 -07:00

..

dev

[Core][Frontend] Add weight version tagging for RL rollouts (#49040)

2026-07-28 14:35:29 +08:00

elastic_ep

[Elastic EP] Async preparation (#47288)

2026-07-28 05:19:13 -07:00

engine

[Frontend] Add detokenization streaming derender for disaggregated serving (#47301)

2026-07-29 18:01:20 -07:00

fault_tolerance

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

instrumentator

[Frontend] Refactor ServingTokenization entrypoint. (#46022)

2026-06-22 06:27:58 +00:00

lora

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

profile

[Cleanup] Refactor profiling env vars into a CLI config (#29912)

2025-12-09 13:29:33 -05:00

sagemaker

[Frontend] Refine the entrypoint class's inheritance hierarchy. (#47498)

2026-07-03 10:50:06 +00:00

tokenize

[Frontend] Split ServingRender into renderer and entrypoint. (#44285)

2026-06-23 11:19:09 +00:00

utils

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

__init__.py

[Frontend] Consolidate dev entrypoints. (#44170)

2026-06-02 06:30:21 -07:00