vLLM/tests/v1/worker at dffbb714e4e8e4b95ccc888df98d47c7d2cef78d - vLLM

__init__.py

[V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681 )

2024-12-26 19:02:58 +09:00

test_attn_utils.py

[5/N] Share HiSparse host cache across TP ranks (reopens #52760 ) (#56629 )

2026-09-12 19:48:25 -04:00

test_cp_utils.py

DCP supports hybrid attention (#40996 )

2026-07-09 21:34:45 -07:00

test_dspark_utils.py

[Bugfix][Spec Decode][MoE] Avoid uninitialized EPLB state in DeepSeek V4.1 DSpark drafter (#56387 )

2026-09-15 14:35:47 +00:00

test_dsv4_packed_zeroer_geometry.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781 )

2026-09-12 00:36:47 -04:00

test_eagle3_aux_hidden_states_pp.py

[Core][MRV2] Support eagle3 spec decode with pipeline parallel (#50514 )

2026-09-05 11:45:34 +08:00

test_encoder_runner.py

[ModelRunnerV2] Support prompt embeds (#42963 )

2026-08-17 21:58:50 +00:00

test_gpu_autoregressive_speculator.py

[Model Runner V2] Acceptance estimation for adaptive verification (#52228 )

2026-09-14 15:58:48 -07:00

test_gpu_bad_words.py

[Bugfix][Model Runner V2][Spec Decode] Fix off-by-one in bad_words draft-prefix matching (#52311 )

2026-08-16 09:02:20 +00:00

test_gpu_batch_ordering.py

[Spec Decode] DSpark confidence-scheduled verification (#47808 )

2026-08-12 12:27:48 -07:00

test_gpu_batch_shard.py

[Bugfix][PP] Never drop a decoding request from the sampled-token broadcast (#54436 )

2026-08-31 23:49:54 +00:00

test_gpu_block_table.py

[Model] Support Qwen3.8-Flash-Next (#53896 )

2026-08-31 05:57:56 +00:00

test_gpu_extract_hidden_states_speculator.py

[Model Runner V2] Acceptance estimation for adaptive verification (#52228 )

2026-09-14 15:58:48 -07:00

test_gpu_gumbel_sample.py

[Bugfix][Model Runner V2][Spec Decode] Decouple the draft's gumbel noise stream from the target's (#54282 )

2026-08-29 09:58:29 -07:00

test_gpu_input_batch_v2.py

[Bugfix][MRV2] Initialize DCP metadata after batch partitioning (#55212 )

2026-09-10 06:50:09 +00:00

test_gpu_input_batch.py

[Pooling] Improve BGE-M3 sync pooling throughput by up to 3.13% (#53464 )

2026-08-24 08:33:32 -04:00

test_gpu_kv_connector.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781 )

2026-09-12 00:36:47 -04:00

test_gpu_logit_bias.py

[Structured Output] Let terminal grammars stop under min_tokens (II) (#54218 )

2026-08-31 20:39:27 +04:00

test_gpu_model_runner_mm_gather.py

Encoder cache extension hooks (#48218 )

2026-07-24 02:52:00 -07:00

test_gpu_model_runner_v2_cudagraph_profiling.py

[Bugfix][V2] Warm up kernels before capturing CUDA graphs (#55341 )

2026-09-04 22:44:18 +00:00

test_gpu_model_runner_v2_eplb.py

[MRV2][Metrics] Support CUDAGraphStat in MRV2 (#52358 )

2026-09-04 07:19:50 +00:00

test_gpu_model_runner_v2.py

[CI] Initialize warmup registry in V2 QSA runner fixture (#56707 )

2026-09-13 13:34:09 -04:00

test_gpu_model_runner.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781 )

2026-09-12 00:36:47 -04:00

test_gpu_pcp_manager.py

[Feature][PCP] Support decode-only FULL CUDA graphs (#53867 )

2026-09-15 16:27:46 +08:00

test_gpu_profiler.py

[Profiler] Add Proton CUDA graph attribution for MRV2 (#51084 )

2026-09-14 19:02:07 +00:00

test_gpu_rejection_sampler_chunking.py

[Feature][DSpark]: Logprobs adaptive verification (#52242 )

2026-08-25 10:22:33 -04:00

test_gpu_rejection_sampler_i64.py

[Bugfix][Model Runner V2][Spec Decode] Fix int32 offset overflow in block verification kernels (#47383 )

2026-07-02 07:32:38 -07:00

test_gpu_sampler_flags.py

[Performance][MRV2] Cache logits-processing request state (#52329 )

2026-08-17 02:36:41 +00:00

test_gpu_thinking_budget.py

[Performance][MRV2] Cache logits-processing request state (#52329 )

2026-08-17 02:36:41 +00:00

test_gpu_trace_replay.py

[Core][V1] Support trace_decode_token_ids for deterministic decode replay (#46701 )

2026-08-20 15:12:43 +08:00

test_gpu_ubatch_slicing.py

[2/2][Model Runner V2] FULL CUDA graph capture for microbatched steps (DBO) (#51700 )

2026-09-13 22:42:33 -07:00

test_gpu_warmup_blocks.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781 )

2026-09-12 00:36:47 -04:00

test_gpu_worker_weight_transfer.py

[RL] Add rank-local IPC weight updates (#52497 )

2026-08-26 15:36:57 +08:00

test_gpu_worker.py

[Bugfix][Core] Wait for the previous PP tensor sends before the next forward pass (#54962 )

2026-09-03 08:01:36 +00:00

test_jit_warmup_migration.py

[3/N][Feat][Perf] Add new warmup infrastructure for JITs. Add provider registry and orchestration for JIT warmup (#50174 )

2026-08-17 10:11:14 -07:00

test_kv_block_zeroer.py

[Model] add GLM-5.3-Flash support (#53906 )

2026-09-03 09:40:35 -07:00

test_kv_cache_allocation_scope.py

[5/N] Share HiSparse host cache across TP ranks (reopens #52760 ) (#56629 )

2026-09-12 19:48:25 -04:00

test_late_interaction_runner.py

[Core] Move MRV1 late_interaction_runner.py out of MRV2 subtree (#48014 )

2026-07-08 18:30:11 +00:00

test_mamba_hybrid_model_state.py

[Model] add GLM-5.3-Flash support (#53906 )

2026-09-03 09:40:35 -07:00

test_mamba_utils.py

[Model] Support Qwen3.8-Flash-Next (#53896 )

2026-08-31 05:57:56 +00:00

test_mixed_warmup_gate.py

[3/N] HiSparse: host-resident sparse-MLA decode hot-buffering (#53781 )

2026-09-12 00:36:47 -04:00

test_mrope_prompt_embeds.py

[Security] Fix DoS via prompt_embeds on M-RoPE models (#45252 )

2026-06-13 10:17:38 +00:00

test_pp_utils.py

[Bugfix][PP] Never drop a decoding request from the sampled-token broadcast (#54436 )

2026-08-31 23:49:54 +00:00

test_prompt_embeds_state.py

[ModelRunnerV2] Support prompt embeds (#42963 )

2026-08-17 21:58:50 +00:00

test_sleep_mode_backend.py

[Core] Release NCCL communicator memory in sleep mode (#51485 )

2026-09-01 14:31:16 +08:00

test_spec_decode_embed_sharing_pp.py

[Core][MRV2] Support eagle3 spec decode with pipeline parallel (#50514 )

2026-09-05 11:45:34 +08:00

test_utils.py

[5/N] Share HiSparse host cache across TP ranks (reopens #52760 ) (#56629 )

2026-09-12 19:48:25 -04:00

test_worker_memory_snapshot.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145 )

2026-03-12 07:57:47 -07:00

test_workspace.py

[Bugfix][V2] Warm up kernels before capturing CUDA graphs (#55341 )

2026-09-04 22:44:18 +00:00

test_xpu_model_runner.py

[XPU] Fix CUDA API shims breaking Torch Dynamo during AOT compile (#43092 )

2026-07-06 08:29:20 +08:00