6 people e77daef89e [Model] Support DeepSeek-V4.1-Flash (#56214) ...

Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: andyluo7 <andy.luo@amd.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>

2026-09-11 02:11:19 -07:00

..

attention

[Model] Support DeepSeek-V4.1-Flash (#56214)

2026-09-11 02:11:19 -07:00

core

[Model] Support DeepSeek-V4.1-Flash (#56214)

2026-09-11 02:11:19 -07:00

engine

[Bugfix][Elastic EP] Route only to surviving engines during scale-down (#55772)

2026-09-08 21:28:28 -05:00

executor

[Refactor] Remove utils dead code (#53941)

2026-09-08 11:22:09 -04:00

fault_tolerance

[Feature] Add fault tolerance framework (simplified) for DP+EP external LB deployments (#44428)

2026-07-25 11:49:09 -04:00

kv_offload

[Refactor][kv_offload]: rename block→chunk (#52615)

2026-09-09 17:45:49 +03:00

metrics

[Feat] Add request-level preemption count histogram metric (#49984)

2026-08-31 23:04:54 -04:00

pool

[Pooling] Improve BGE-M3 sync pooling throughput by up to 3.13% (#53464)

2026-08-24 08:33:32 -04:00

sample

[Core] Triton kernel for small-batch top-p only masking (#54651)

2026-09-03 07:52:47 -07:00

simple_kv_offload

[Model] Support DeepSeek-V4.1-Flash (#56214)

2026-09-11 02:11:19 -07:00

spec_decode

[Model] Add Bailing V3 VL support (#55921)

2026-09-10 02:46:56 -07:00

structured_output

[Bugfix] Avoid MistralCommonBackend for HF tokenizers (#54192)

2026-09-10 17:57:44 +00:00

watermarking

[feature] Watermarked generation and detection (Gumbel-max algorithm) (#54053)

2026-09-09 21:00:15 -07:00

worker

[Model] Support DeepSeek-V4.1-Flash (#56214)

2026-09-11 02:11:19 -07:00

__init__.py

…

cudagraph_dispatcher.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

kv_cache_interface.py

[Kimi K3] Support internal prefix checkpoints with partial prefix caching and spec-decoding (#53614)

2026-09-06 13:18:15 +08:00

kv_cache_layout.py

[6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718)

2026-08-21 17:47:49 -07:00

kv_cache_spec_registry.py

[KVCache] Support Pluggable KVCacheSpec (#37505)

2026-06-03 09:05:16 -07:00

outputs.py

[Perf][Model Runner V2] Compact sampling masks on GPU instead of unpacking the full-vocab bitmask on CPU (#54901)

2026-09-03 19:03:36 -07:00

request.py

[Frontend][Core][Spec Decode] Per-request acceptance stats in OpenAI API responses (#48915)

2026-08-20 15:42:49 -07:00

serial_utils.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

utils.py

[Bugfix][Frontend] Keep credentials out of the Rust frontend launch log (#53738)

2026-08-25 16:32:12 +00:00