[V1] LoRA - Enable Serving Usecase (#12883)

Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
This commit is contained in:
Varun Sundar Rabindranath
2025-02-14 14:21:12 +08:00
committed by GitHub
co-authored by Varun Sundar Rabindranath
parent f0b2da72a8
commit cbc40128eb
7 changed files with 210 additions and 7 deletions
+1
View File
@@ -134,3 +134,4 @@ class EngineCoreRequestType(enum.Enum):
ABORT = b'\x01'
PROFILE = b'\x02'
RESET_PREFIX_CACHE = b'\x03'
ADD_LORA = b'\x04'