Martin Hickey 0a31372e5f [Frontend] Add detokenization streaming derender for disaggregated serving (#47301) ...

Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>

2026-07-29 18:01:20 -07:00

..

inputs

[Bugfix] Normalize malformed dict prompts that carry token IDs in prompt (#40339)

2026-04-21 07:44:36 +00:00

__init__.py

[Chore] Move BaseRenderer to base.py (#34308)

2026-02-11 00:29:51 -08:00

base.py

[Perf] Isolate MM preprocessing on its own executor (#49524)

2026-07-26 08:04:17 +00:00

deepseek_v4.py

[Refactor] Remove deepseek dead code (#48780)

2026-07-17 14:57:13 +00:00

deepseek_v32.py

[Refactor] Remove deepseek dead code (#48780)

2026-07-17 14:57:13 +00:00

embed_utils.py

[Bugfix][Security] Fix concurrent sparse invariant race bypassing CVE remediation (#48583)

2026-07-14 11:08:24 +00:00

hf.py

[Bugfix][Renderer] Rebuild vision chunk UUIDs in async render path (#49400)

2026-07-22 14:11:24 +00:00

inkling_encoding.py

[Model] Add Inkling model support [1/N] (#48799)

2026-07-15 23:40:07 -07:00

inkling.py

[Model] Add Inkling model support [1/N] (#48799)

2026-07-15 23:40:07 -07:00

kimi_k3.py

[Model] Add Kimi K3 support: Python frontend [2/2] (#50093)

2026-07-29 01:06:01 -07:00

mistral.py

[Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop (#34789)

2026-03-26 22:17:00 -07:00

online_derenderer.py

[Frontend] Add detokenization streaming derender for disaggregated serving (#47301)

2026-07-29 18:01:20 -07:00

online_renderer.py

[Frontend] Reuse prefill token ids on the decode chat path for disaggregated serving (#48145)

2026-07-29 10:02:57 +02:00

params.py

[Model] Add Kimi K3 support: Python frontend [2/2] (#50093)

2026-07-29 01:06:01 -07:00

registry.py

[Model] Add Kimi K3 support: Python frontend [2/2] (#50093)

2026-07-29 01:06:01 -07:00

terratorch.py

[Renderer] Consolidate factory methods (#38218)

2026-03-26 12:19:22 +00:00