3 people de8291e24f [Core] Add lifecycle hooks for worker extensions (#59463) ...

Signed-off-by: Dakai An <dakaian108@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>

2026-10-13 21:51:05 +08:00

..

__init__.py

[V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681)

2024-12-26 19:02:58 +09:00

test_attn_utils.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

test_cp_utils.py

[PCP][DCP] Support DCP target model with non-DCP Dspark (#56723)

2026-09-26 18:12:35 -04:00

test_dspark_utils.py

[EPLB] Add EPLB support to dspark draft models (DeepSeekV4) (#57549)

2026-10-12 10:03:09 -04:00

test_dsv4_packed_zeroer_geometry.py

[Core][Refactor] Move KV cache planning logic to kv_cache_planning.py (#61183)

2026-10-13 03:05:39 +00:00

test_eagle3_aux_hidden_states_pp.py

[MRV2] Switch CI tests still running on MRV1 unnecessarily (#61014)

2026-10-11 09:57:07 -07:00

test_encoder_runner.py

[Perf][Multimodal] Sort multimodal encoder inputs by modality (#60196)

2026-10-09 10:55:36 +08:00

test_gpu_bad_words.py

[Model Runner V2] Support custom logits processors (#56497)

2026-09-19 17:46:49 +00:00

test_gpu_batch_ordering.py

[Perf][PP] Skip sampled-token broadcasts whose requests leave the engine (#58542)

2026-09-30 19:18:55 -07:00

test_gpu_batch_shard.py

[Perf][MRV2] Allow FULL decode graphs for one-token prompt tails (#58400)

2026-09-28 12:48:52 -07:00

test_gpu_block_table.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

test_gpu_extract_hidden_states_speculator.py

[ModelRunner V2] Speculative Decoding NGram GPU Implementations (#40704)

2026-10-06 13:32:59 -07:00

test_gpu_gumbel_sample.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_gpu_input_batch_v2.py

[MRV2] Miscellaneous code cleanup (#57980)

2026-09-23 01:51:52 -07:00

test_gpu_input_batch.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

test_gpu_kpool_tail_slot_mapping.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

test_gpu_kv_connector.py

[MRV2] Miscellaneous code structure updates (#60754)

2026-10-09 17:58:09 -07:00

test_gpu_logit_bias.py

[Model Runner V2] Support custom logits processors (#56497)

2026-09-19 17:46:49 +00:00

test_gpu_logits_processors.py

[Model Runner V2] Support custom logits processors (#56497)

2026-09-19 17:46:49 +00:00

test_gpu_model_runner_mm_gather.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_gpu_model_runner_prefill_tail_classification.py

[Attention] Remove cascade attention (#61126)

2026-10-12 10:41:07 -07:00

test_gpu_model_runner_v2_cudagraph_profiling.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_gpu_model_runner_v2_eplb.py

[EPLB] Add EPLB support to dspark draft models (DeepSeekV4) (#57549)

2026-10-12 10:03:09 -04:00

test_gpu_model_runner_v2.py

[Bug] Honor spec decode draft model config (#61240)

2026-10-12 15:13:23 -04:00

test_gpu_model_runner.py

[Core][Refactor] Move KV cache planning logic to kv_cache_planning.py (#61183)

2026-10-13 03:05:39 +00:00

test_gpu_pcp_manager.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

test_gpu_profiler.py

[Metrics] Expose cached prompt tokens by cache tier (#56318)

2026-10-06 14:52:05 -04:00

test_gpu_rejection_sampler_chunking.py

[Feature][Spec Decode] Support sampling mask replay for MRV2 MTP (#59359)

2026-10-01 13:51:39 +08:00

test_gpu_rejection_sampler_i64.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_gpu_row_offsets_i64.py

[Bugfix][MRV2] Use int64 index mappings to fix row-offset overflow (#60736)

2026-10-09 14:38:11 -07:00

test_gpu_sampler_flags.py

[Model Runner V2] Support custom logits processors (#56497)

2026-09-19 17:46:49 +00:00

test_gpu_target_dependent_ar_speculator.py

[Attention] Remove cascade attention (#61126)

2026-10-12 10:41:07 -07:00

test_gpu_thinking_budget.py

[Model Runner V2] Support custom logits processors (#56497)

2026-09-19 17:46:49 +00:00

test_gpu_trace_replay.py

[Core][V1] Support trace_decode_token_ids for deterministic decode replay (#46701)

2026-08-20 15:12:43 +08:00

test_gpu_ubatch_slicing.py

[MRV2] Miscellaneous code structure updates (#60754)

2026-10-09 17:58:09 -07:00

test_gpu_warmup_blocks.py

[Bugfix][MRV2][Spec Decode] Honor dynamic K in autoregressive speculators, 1.2~1.3x kernel perf improvement (#57053)

2026-10-05 14:54:11 -04:00

test_gpu_worker_weight_transfer.py

[RL] Release weight-transfer communicators without stopping inference (#61060)

2026-10-11 21:15:14 +08:00

test_gpu_worker.py

[MRV2] Switch CI tests still running on MRV1 unnecessarily (#61014)

2026-10-11 09:57:07 -07:00

test_grammar_invalid_drafts.py

[Bugfix] Don't let a structured-output request sample from an unmasked row (#54442)

2026-10-01 02:11:44 +00:00

test_jit_warmup_migration.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

test_kv_block_zeroer.py

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

2026-09-16 10:57:24 -07:00

test_kv_cache_allocation_scope.py

[KV Cache] GLM-5.3-Flash: use the generic packed KV layout; CircularBufferSpec tail with speculative ring slots (#57169)

2026-10-09 15:48:37 -04:00

test_late_interaction_runner.py

[Bugfix][Pooling] Handle multimodal cache misses without crashing (#58975)

2026-10-02 10:14:33 -04:00

test_logits_processor_loader.py

[Model Runner V2] Support custom logits processors (#56497)

2026-09-19 17:46:49 +00:00

test_mamba_hybrid_model_state.py

[Bugfix][RecoverSSM] Correct aligned state indices at exact block boundaries (#59962)

2026-10-12 02:08:14 +00:00

test_mamba_utils.py

[Attention] Remove cascade attention (#61126)

2026-10-12 10:41:07 -07:00

test_mixed_warmup_gate.py

[CI] Fix test_mixed_warmup_gate after #57053 (#60116)

2026-10-05 21:17:00 +00:00

test_mrope_prompt_embeds.py

[Security] Fix DoS via prompt_embeds on M-RoPE models (#45252)

2026-06-13 10:17:38 +00:00

test_pp_utils.py

[Perf][PP] Skip sampled-token broadcasts whose requests leave the engine (#58542)

2026-09-30 19:18:55 -07:00

test_prompt_embeds_state.py

[XPU][CI] enable prompt embeds tests on XPU (#58283)

2026-09-25 06:56:59 +08:00

test_sleep_mode_backend.py

[CI] Split (H200 MIG/MI300) Basic Correctness into named jobs (#57054)

2026-09-25 17:05:33 -07:00

test_spec_decode_embed_sharing_pp.py

[Bugfix][MiniMax M3] Share target embeddings with MTP under PP (#58648)

2026-09-29 20:04:10 -07:00

test_utils.py

[HiSparse] Own GPU residency instead of editing core block-table rows (#60647)

2026-10-09 21:25:44 -07:00

test_worker_base.py

[Core] Add lifecycle hooks for worker extensions (#59463)

2026-10-13 21:51:05 +08:00

test_worker_memory_snapshot.py

Add pydocstyle to the ruff rules (#52136)

2026-09-16 16:44:29 +00:00

test_workspace.py

[Core][Kernel] Share persistent workspaces for Marlin and Humming (#57421)

2026-09-20 17:28:33 +08:00

test_xpu_model_runner.py

[XPU] Fix CUDA API shims breaking Torch Dynamo during AOT compile (#43092)

2026-07-06 08:29:20 +08:00