[Core] Enable inputs_embeds_size separate from hidden_size (#29741)

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
This commit is contained in:
Cyrus Leung
2025-11-30 17:31:12 +08:00
committed by GitHub
parent 47539cfd3e
commit 64bc09ba27
10 changed files with 123 additions and 18 deletions
+1 -1
View File
@@ -17,7 +17,7 @@ class InputBuffers:
self,
max_num_reqs: int,
max_num_tokens: int,
hidden_size: int,
inputs_embeds_size: int,
vocab_size: int,
dtype: torch.dtype,
device: torch.device,