[Performance][DeepGEMM] Estimate expected_m (#28694)

Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
This commit is contained in:
Varun Sundar Rabindranath
2025-11-15 13:52:14 +08:00
committed by GitHub
co-authored by Varun Sundar Rabindranath
parent c9e665852a
commit 6965ef436f
3 changed files with 73 additions and 17 deletions
+4
View File
@@ -221,6 +221,10 @@ def get_forward_context() -> ForwardContext:
return _forward_context
def is_forward_context_available() -> bool:
return _forward_context is not None
def create_forward_context(
attn_metadata: Any,
vllm_config: VllmConfig,