iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
23,341 Commits 3 Branches 0 Tags
patches
Commit Graph
63 Commits
Author SHA1 Message Date
Aarushi JainandAndreas Karatzas fa423b614c [CI][ROCm] Wait for engine teardown between LM Eval models (#60100) 
Signed-off-by: aarushjain29 <aarushi.jain2@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-10-05 23:39:59 +00:00
Chaojun ZhangandCopilot 1fee69838e [XPU] Fix Nemotron FP8 LM-eval config: drop CUDA-only moe_backend and wire to new Buildkite job (#49685) 
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
 2026-09-22 10:05:26 +08:00
Harry MellorandClaude Opus 5 8c1557a79c Add pydocstyle to the ruff rules (#52136) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Harry Mellor <hej.mellor@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-09-16 16:44:29 +00:00
Andreas KaratzasandOpenAI Codex c6005000d3 [CI][ROCm] Prefetch safetensors weights in AMD CI (#54898) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-02 03:28:39 -05:00
Colin ZandAndreas Karatzas bc11ecaf4e [CI] Add GSM8K accuracy test for amd/DeepSeek-V4-Flash-MXFP4 (#50632) 
Signed-off-by: Colin Zeng <Colin.Zeng@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-08-25 09:06:58 -07:00
Andreas Karatzas 3ad85e0de4 [CI][AMD] Configure MI300 tests for native execution without DinD (#48387) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-15 02:14:16 +00:00
Harry Mellor 03878d1c22 Deprecations for v0.23 and v0.24 (#44992) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-11 14:35:38 +00:00
Cyrus Leung 2676ab1e0b [Deprecation] Remove old locations of get_tokenizer and resolve_hf_chat_template (#35024) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-05-15 00:13:32 -07:00
Andreas Karatzas 780ba37458 [ROCm][Quantization] Add asymmetric INT8 quantization support to TritonInt8ScaledMMLinearKernel (#38501) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-04-06 09:42:10 +08:00
Kyle Sayers 38364a7e32 [Sparse24] [Deprecation] Remove Sparse24 CT integration and kernels (#36799) 
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
 2026-03-23 16:03:29 -04:00
Andreas Karatzas 040a505ff5 [ROCm][CI] Cleaning and restructuring amd-ci legacy pipeline (#34839) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-19 14:30:58 -05:00
Micah Williamson 4ff9b045fe [ROCm][CI] Prep Tests For Change To ROCM_ATTN As New Default Backend On ROCm (#36025) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-03-09 13:27:55 -05:00
Charlie Fu 3c85cd9d74 [Rocm][CI] Fix ROCm LM Eval Large Models (8 Card) (#35913) 
Signed-off-by: charlifu <charlifu@amd.com>
 2026-03-04 04:50:13 +00:00
Charlie Fu 3fd1d4ec2c [Rocm][CI] Fix LM Eval Large Models (H100) test group (#34750) 
Signed-off-by: charlifu <charlifu@amd.com>
 2026-03-02 07:43:38 +00:00
junuxyz c61a98f529 [CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514) 
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com>
 2026-02-17 12:22:56 +00:00
Harry Mellor a21cedf4ff Bump lm-eval version for Transformers v5 compatibility (#33994) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-02-16 05:24:35 -08:00
shaharmor98 4bc913aeec Feat/add nemotron nano v3 tests (#33345) 2026-02-03 08:52:49 -05:00
vllmellm 148117ea2e [Refactor] Make FP8 Linear Ops use kernel abstraction (#27814) 
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
 2026-01-20 14:48:20 +08:00
Micah Williamson ac0675ff6b [CI] Allow Deprecated Quantization For LM Eval Tests (#32065) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-01-09 19:10:47 -07:00
Cyrus Leung d201807339 [Chore] Bump lm-eval version (#31264) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-12-24 05:39:13 -08:00
Zhewen Li bcf43ab1f3 [CI/Build][AMD] Add Llama4 Maverick FP8 to AMD CI (#28695) 
Signed-off-by: zhewenli <zhewenli@meta.com>
 2025-12-04 16:07:20 -08:00
Michael Goin f32229293e Disable nm-testing models with issues in CI (#28206) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-11-06 06:19:07 -08:00
Huamin Li 5be1bed790 [CI/Build]Add eval config for Qwen3-235B-A22B-Instruct-2507-FP8 (#27113) 
Signed-off-by: Huamin Li <3ericli@gmail.com>
 2025-10-30 07:50:56 +00:00
Zhewen Li 9c2c2287a0 [CI/Build] Update Llama4 eval yaml (#27070) 
Signed-off-by: zhewenli <zhewenli@meta.com>
 2025-10-17 04:59:47 +00:00
Zhewen LiYe QiYe Qi
 		f3c378ffa7 [CI/Build] Add Qwen2.5-VL-7B-Instruct ChartQA Accuracy Tests in CI (#21810) 
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Signed-off-by: zhewenli <zhewenli@meta.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Ye (Charlotte) Qi <ye.charlotte.qi@gmail.com>
 2025-10-15 08:09:56 +00:00
Cyrus Leung 8896eb72eb [Deprecation] Remove prompt_token_ids arg fallback in LLM.generate and LLM.embed (#18800) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-08-22 10:56:57 +08:00
Michael Goin 0cdbf5e61c [Kernel/Quant] Remove the original marlin format and qqq (#23204) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-08-20 15:13:36 -04:00
Michael Goin 1a4f35e2ea Normalize lm-eval command between baseline and correctness test (#18560) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-07-10 13:27:32 +00:00
Simon Mo 02f0c7b220 [Misc] Add SPDX-FileCopyrightText (#19100) 
Signed-off-by: simon-mo <simon.mo@hey.com>
 2025-06-03 11:20:17 -07:00
Harry Mellor 98fcba1575 Convert .buildkite to ruff format (#17656) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-13 09:28:31 +00:00
Michael Goin 8342e3abd1 [CI] Prune down lm-eval small tests (#17012) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-05-08 19:00:26 +00:00
Michael Goin 950b71186f Replace lm-eval bash script with pytest and use enforce_eager for faster CI (#17717) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-05-06 18:00:10 -07:00
Reidandreidliu41 3642c59aa8 [CI/Build] remove -t for run-lm-eval-gsm-hf-baseline.sh (#16271) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-26 18:25:05 +00:00
Michael Goin 6317a5174a Categorize tests/kernels/ based on kernel type (#16799) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-04-23 09:21:07 -04:00
Michael Goin 71eda0bb76 Update Qwen1.5-MoE-W4A16-compressed-tensors.yaml (#16946) 2025-04-21 18:35:32 -06:00
Michael Goin c70cf0fe06 [Kernel] Use moe_wna16 kernel for compressed tensors wna16 moe models (#16038) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-04-10 15:08:47 +08:00
Robert Shawrshaw@neuralmagic.com <rshaw@neuralmagic.com>Nicolò LucchesiTyler Michael SmithMichael Goin
 		d4d93db2c5 [V1] V1 Enablement Oracle (#13726) 
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
 2025-03-14 22:02:20 -07:00
Rahul Tuli 3b2005e1db Add: Support for Sparse24Bitmask Compressed Models 2025-02-05 13:30:43 -08:00
Russell Bryant e489ad7a21 [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 
- **Add SPDX license headers to python source files**
- **Check for SPDX headers using pre-commit**

commit 9d7ef44c3cfb72ca4c32e1c677d99259d10d4745
Author: Russell Bryant <rbryant@redhat.com>
Date:   Fri Jan 31 14:18:24 2025 -0500

    Add SPDX license headers to python source files
    
This commit adds SPDX license headers to python source files as
recommended to
the project by the Linux Foundation. These headers provide a concise way
that is
both human and machine readable for communicating license information
for each
source file. It helps avoid any ambiguity about the license of the code
and can
    also be easily used by tools to help manage license compliance.
    
The Linux Foundation runs license scans against the codebase to help
ensure
    we are in compliance with the licenses of the code we use, including
dependencies. Having these headers in place helps that tool do its job.
    
    More information can be found on the SPDX site:
    
    - https://spdx.dev/learn/handling-license-info/
    
    Signed-off-by: Russell Bryant <rbryant@redhat.com>

commit 5a1cf1cb3b80759131c73f6a9dddebccac039dea
Author: Russell Bryant <rbryant@redhat.com>
Date:   Fri Jan 31 14:36:32 2025 -0500

    Check for SPDX headers using pre-commit
    
    Signed-off-by: Russell Bryant <rbryant@redhat.com>

---------

Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-02-02 11:58:18 -08:00
Russell Bryant 3be5b26a76 [CI/Build] Add shell script linting using shellcheck (#7925) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2024-11-07 18:17:29 +00:00
Joe Runde ef7faad1b8 🐛 Fixup more test failures from memory profiling (#9563) 
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
 2024-10-21 17:10:56 -07:00
Michael Goin 9ba0bd6aa6 Add lm-eval directly to requirements-test.txt (#9161) 2024-10-08 18:22:31 -07:00
Luka Govedič 172d1cd276 [Kernel] AQ AZP 4/4: Integrate asymmetric quantization to linear method (#7271) 2024-09-27 14:25:10 -04:00
Michael Goin af59df0a10 Remove faulty Meta-Llama-3-8B-Instruct-FP8.yaml lm-eval test (#7961) 2024-08-28 19:19:17 -04:00
Luka GovedičandMichael Goin 7937009a7e [Kernel] Replaced blockReduce[...] functions with cub::BlockReduce (#7233) 
Co-authored-by: Michael Goin <michael@neuralmagic.com>
 2024-08-21 20:18:00 -04:00
Michael Goin 44f26a9466 [Model] Align nemotron config with final HF state and fix lm-eval-small (#7611) 2024-08-16 15:56:34 -07:00
Dipika Sikka 181abbc27d [Misc] Update LM Eval Tolerance (#7473) 2024-08-13 14:28:14 -04:00
Dipika Sikka a3bbbfa1d8 [BugFix] Fix DeepSeek remote code (#7178) 2024-08-06 08:16:53 -07:00
HandH1998 6512937de1 Support W4A8 quantization for vllm (#5218) 2024-07-31 07:55:21 -06:00
Michael Goin 07278c37dd [Model] Support Nemotron models (Nemotron-3, Nemotron-4, Minitron) (#6611) 2024-07-26 14:33:42 -04:00