[Mini-vLLM] SM86-only cut: models, backends, Rust, tests
- Keep only Qwen3.5, Qwen3.5-MTP and Qwen4Exp model paths; trim the model registry to 41 entries - Delete idle attention backends (MLA, FlashInfer, ROCm-only, quant backends) and dead GDN CuTeDSL kernels - Remove inc/quark quant loaders; keep compressed-tensors and Marlin - Drop the Rust frontend, pooling entrypoints, and idle test suites - Rebuild kernels for sm_80;sm_86 and strip the extensions - Verified: full import sweep clean (optional deps only) and a dummy-load Qwen3.5 engine run on RTX 3090 via the Triton GDN path Co-authored-by: Hinata <hinata@idihore.id> Signed-off-by: MOVZX <movzx@yahoo.com>
This commit is contained in:
@@ -3,7 +3,6 @@ ninja
|
||||
packaging>=24.2
|
||||
setuptools==78.1.1 # this version can reuse CMake build dir; >=78.1.1 for GHSA-5rjg-fvgr-3xxf
|
||||
setuptools-scm>=8
|
||||
setuptools-rust>=1.9.0
|
||||
torch==2.14.0+cpu; platform_machine == "x86_64" or platform_machine == "s390x" or platform_machine == "aarch64"
|
||||
torch==2.14.0; platform_system == "Darwin" or platform_machine == "ppc64le" or platform_machine == "riscv64"
|
||||
wheel
|
||||
|
||||
@@ -4,7 +4,6 @@ ninja
|
||||
packaging>=24.2
|
||||
setuptools>=78.1.1,<81.0.0
|
||||
setuptools-scm>=8
|
||||
setuptools-rust>=1.9.0
|
||||
torch==2.14.0
|
||||
wheel
|
||||
jinja2>=3.1.6
|
||||
|
||||
@@ -11,7 +11,6 @@ cmake>=3.26.1,<4
|
||||
packaging>=26.2
|
||||
setuptools>=78.1.1,<80.0.0
|
||||
setuptools-scm>=8
|
||||
setuptools-rust>=1.9.0
|
||||
wheel
|
||||
jinja2>=3.1.6
|
||||
amdsmi==7.0.2
|
||||
|
||||
@@ -11,7 +11,6 @@ cmake>=3.26.1,<4
|
||||
packaging>=26.2
|
||||
setuptools>=78.1.1,<80.0.0
|
||||
setuptools-scm>=8
|
||||
setuptools-rust>=1.9.0
|
||||
wheel
|
||||
jinja2>=3.1.6
|
||||
amdsmi==7.0.2
|
||||
|
||||
@@ -1,5 +0,0 @@
|
||||
# Dependencies for building Rust artifacts through setuptools-rust.
|
||||
setuptools>=78.1.1,<81.0.0
|
||||
setuptools-scm>=9.2.0
|
||||
setuptools-rust>=1.9.0
|
||||
wheel
|
||||
@@ -3,6 +3,5 @@ cmake>=3.26.1
|
||||
ninja
|
||||
setuptools>=78.1.1,<81.0.0
|
||||
setuptools-scm>=8
|
||||
setuptools-rust>=1.9.0
|
||||
torch==2.13.0+cpu
|
||||
wheel
|
||||
|
||||
@@ -15,7 +15,6 @@ tensorizer==2.10.1
|
||||
packaging>=24.2
|
||||
setuptools>=78.1.1,<80.0.0
|
||||
setuptools-scm>=8
|
||||
setuptools-rust>=1.9.0
|
||||
runai-model-streamer[s3,gcs,azure]==0.15.7
|
||||
conch-triton-kernels==1.2.1
|
||||
timm>=1.0.17
|
||||
|
||||
@@ -9,6 +9,5 @@ wheel
|
||||
jinja2>=3.1.6
|
||||
ray[default]
|
||||
ray[data]
|
||||
setuptools-rust>=1.9.0
|
||||
nixl==0.3.0
|
||||
tpu-inference==0.31.0
|
||||
|
||||
@@ -7,7 +7,6 @@ ray>=2.9
|
||||
cmake>=3.26.1
|
||||
packaging>=24.2
|
||||
setuptools-scm>=8
|
||||
setuptools-rust>=1.9.0
|
||||
setuptools>=78.1.1,<81.0.0
|
||||
wheel
|
||||
jinja2>=3.1.6
|
||||
|
||||
Reference in New Issue
Block a user