[CI Bug] Fix Chunked prefill is required for mamba cache mode 'align'. (#51177)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
This commit is contained in:
@@ -38,5 +38,6 @@ def test_model_experts_int8_startup(
|
||||
dtype=dtype,
|
||||
enforce_eager=True,
|
||||
quantization="experts_int8",
|
||||
enable_chunked_prefill=True,
|
||||
) as vllm_model:
|
||||
vllm_model.generate_greedy(example_prompts, max_tokens)
|
||||
|
||||
Reference in New Issue
Block a user