3 people 560ef78bfe [Perf][Model Runner V2] Compact sampling masks on GPU instead of unpacking the full-vocab bitmask on CPU (#54901) ...

Signed-off-by: aoshen02 <aoshen@inferact.ai>
Signed-off-by: vx120 <893600387@qq.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: vx120 <893600387@qq.com>

2026-09-03 19:03:36 -07:00

..

__init__.py

[Model Runner V2] Add sample/ directory and reorganize files (#29719)

2025-11-29 00:41:01 -08:00

bad_words.py

[Bugfix][Model Runner V2][Spec Decode] Fix off-by-one in bad_words draft-prefix matching (#52311)

2026-08-16 09:02:20 +00:00

batch_shard.py

[Model Runner V2] batch-sharded sample (#50465)

2026-08-24 15:49:57 -07:00

gumbel.py

[Bugfix][Model Runner V2][Spec Decode] Decouple the draft's gumbel noise stream from the target's (#54282)

2026-08-29 09:58:29 -07:00

logit_bias.py

[Structured Output] Let terminal grammars stop under min_tokens (II) (#54218)

2026-08-31 20:39:27 +04:00

logprob.py

[Feature][DSpark]: Logprobs adaptive verification (#52242)

2026-08-25 10:22:33 -04:00

min_p.py

[Bugfix][Model Runner V2][Spec Decode] Fix int32 offset overflow in sampler kernels (#46560)

2026-06-24 11:00:57 -07:00

output.py

[Perf][Model Runner V2] Compact sampling masks on GPU instead of unpacking the full-vocab bitmask on CPU (#54901)

2026-09-03 19:03:36 -07:00

penalties.py

[Bugfix][Model Runner V2][Spec Decode] Fix int32 offset overflow in sampler kernels (#46560)

2026-06-24 11:00:57 -07:00

prompt_logprob.py

[MRV2][Spec Decode] Avoid rejection sampler OOM by chunking (#48630)

2026-07-23 18:13:13 +08:00

sampler.py

[Perf][Model Runner V2] Compact sampling masks on GPU instead of unpacking the full-vocab bitmask on CPU (#54901)

2026-09-03 19:03:36 -07:00

states.py

[Model Runner V2] Fix openai.InternalServerError: Error code: 500 - 'list index out of range' (#45467)

2026-06-13 01:44:16 -07:00

thinking_budget.py

[Feat] Support thinking_token_budget in Model Runner V2 (#46727)

2026-08-07 03:36:18 +00:00

trace_replay.py

[Core][V1] Support trace_decode_token_ids for deterministic decode replay (#46701)

2026-08-20 15:12:43 +08:00