Commit Graph
9 Commits
Author SHA1 Message Date
21445806bd [Rust Frontend] Support logprob_token_ids on OpenAI endpoints (#59549)
Signed-off-by: Wang Zupeng <zupenwang@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-12 19:12:30 +08:00
Zupeng Wang 18f8f96025 [Bugfix][KV Offload] Release pending CPU lookup pins on cache reset (#59862)
Signed-off-by: Wang Zupeng <zupenwang@gmail.com>
2026-10-04 04:30:17 +00:00
7632f767f0 [Rust Frontend] Support HTTP RL weight synchronization (#56567)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: Wang Zupeng <zupenwang@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
2026-09-14 03:37:04 +00:00
Zupeng WangandCodex dd0760165c [Bugfix] Fall back to T1 when ARC cannot reclaim enough entries from T2 (#55461)
Signed-off-by: Wang Zupeng <zupenwang@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-06 13:28:19 +03:00
Zupeng WangOpenAImergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
c21751c90b [Kernel] Warm up Qwen GDN gated RMSNorm (#54251)
Signed-off-by: Zupeng Wang <71580390+zupengwang@users.noreply.github.com>
Co-authored-by: OpenAI <support@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-09-03 18:19:48 +08:00
Zupeng WangandOpenAI 833fa6233c [Benchmark] Warn on warm prefix cache for random serve runs (#53920)
Signed-off-by: Zupeng Wang <71580390+zupengwang@users.noreply.github.com>
Co-authored-by: OpenAI <support@openai.com>
2026-08-27 05:51:17 +00:00
Zupeng Wang 7b7e5cbfcd [Bugfix][LoRA] Restore tower and connector LoRA support for LFM2-VL (#53519)
Signed-off-by: Zupeng Wang <71580390+zupengwang@users.noreply.github.com>
2026-08-25 01:53:04 +00:00
01af92e175 [Feature][Model Runner V2] Support extract_hidden_states speculation (#49811)
Signed-off-by: Zupeng Wang <71580390+zupengwang@users.noreply.github.com>
Signed-off-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: OpenAI <support@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
2026-08-20 11:13:43 -04:00
Zupeng Wang df1376907b [Model] Add tower and connector LoRA support for LFM2-VL (#51498)
Signed-off-by: zupengwang <71580390+zupengwang@users.noreply.github.com>
2026-08-20 20:33:43 +08:00