iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
23,341 Commits 3 Branches 0 Tags
patches
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Tyler Michael SmithandClaude Opus 4.6 fa8c868a3c [Bugfix] Fix Llama4 weight loading (#45047) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-06-10 13:40:45 -04:00
Tyler Michael SmithandClaude Opus 4.6 e2f993dc41 [WideEP] Integrate DeepEP v2 (#41183) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-06-08 18:07:29 -07:00
Tyler Michael Smith 4cc78c9d5d [Core] Freeze garbage collector in workers after model initialization (#44363) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2026-06-04 08:39:04 -07:00
Tyler Michael SmithandClaude Opus 4.6 f72b20976c [Bugfix] Reject non-nvfp4 dtypes when using the flashinfer_nvlink_one_sided all2all backend (#39717) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-13 19:13:51 +00:00
Tyler Michael Smith 5afb387bd4 Change "following fields were present in the request but ignored" log from warn to debug (#36173) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2026-03-05 22:15:46 -08:00
Tyler Michael Smith de7dd634b9 Fix unresolved-import errors when using Astral's ty by removing src.root (#35681) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2026-03-02 10:26:47 +00:00
Tyler Michael SmithandClaude Opus 4.6 eb19955c37 [WideEP] Remove pplx all2all backend (#33724) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-26 14:30:10 -08:00
Tyler Michael SmithandClaude Opus 4.6 d7982daff5 [Bugfix] Fix fused MoE IMA (sans chunking) by using int64 for strides (#34279) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-11 05:15:52 +00:00
Tyler Michael SmithandRobert Shaw 066c6da6a0 [WideEP] Fix nvfp4 DeepEP High Throughput All2All backend (#33738) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-02-10 19:15:43 -08:00
Tyler Michael SmithandClaude Opus 4.6 c4b9e6778f [Misc] Add pre-commit hook to catch boolean ops in with-statements (#34271) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-10 15:13:20 -08:00
Tyler Michael Smith f09c5feb7c Change warning in get_current_vllm_config to report caller's line number (#31855) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2026-01-07 03:48:13 +00:00
Tyler Michael Smith fe8a9fbd2e [Bugfix] Fix EPLB state logging error (#31455) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2026-01-05 04:06:28 +00:00
Tyler Michael Smith 4dd42db566 Remove VLLM_SKIP_WARMUP tip (#29331) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2025-11-24 22:16:05 +00:00
Tyler Michael Smith 3758757377 [Bugfix] Fix MoE Routing Simulation (#28002) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2025-11-03 22:26:49 +00:00
Tyler Michael SmithandNick Hill ab98f6556f [Bugfix] Fix 2 precommit issues - (mamba_block_size, kv_cache_config) (#27811) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
 2025-10-30 11:52:18 -07:00
Tyler Michael Smith 6c2eef5a5d [P/D] KVConnector for decode benchmarking (#25986) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-10-21 16:30:47 -07:00
Tyler Michael SmithandSimon Mo 27edd2aeb4 [Build/CI] Revert back to Ubuntu 20.04, install python 3.12 with uv (#26103) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
 2025-10-02 22:21:01 -07:00
Tyler Michael Smith f9df8b4ad7 [Bugfix] Fix triton import precommit failure (#25803) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2025-09-27 07:13:11 -07:00
Tyler Michael Smith 2e5df88c92 [Logging] Remove TORCH_NCCL_AVOID_RECORD_STREAMS to squash a warning (#25532) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-09-25 15:16:06 +00:00
Tyler Michael Smith 1260180c67 Revert "[Performance] Move apply_w8a8_block_fp8_linear to an op class… (#25607) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2025-09-25 08:05:21 +00:00
Tyler Michael Smith fea8006062 [Logging] Improve log for when DeepEP HT disables CUDA Graphs (#25531) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-09-24 22:43:06 +00:00
Tyler Michael Smith 8b83b93739 [Docs] Document the extra memory footprint overhead when using EPLB (#24537) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-09-10 06:09:49 -07:00
Tyler Michael Smith 561f38dc3c [Bugfix] Improve EPLB config validation error message (#24524) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-09-10 00:32:36 +00:00
Tyler Michael Smith 955c624915 [Bugfix][Wide EP] Fix redundant work when using DeepEP, TP Attn, and EP MoE (#24134) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2025-09-08 19:01:51 -07:00
Tyler Michael Smith 8ecb3e9e93 [CI Bugfix] Fix wNa16 kernel not found for test_shared_storage_connector_hashes (#22163) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-08-03 22:19:04 -07:00
Tyler Michael Smith bdb84e26b0 [Bugfix] Fixes for FlashInfer's TORCH_CUDA_ARCH_LIST (#20136) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
 2025-07-02 17:15:11 -07:00
Tyler Michael Smith 3be8d312a2 [Kernel][Bugfix] Fixup some warnings in nvfp4_blockwise_moe when CUDA < 12.8 (#20324) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-07-01 18:05:47 -07:00
Tyler Michael Smith e8c3bd2cd1 [Bugfix] Fix some narrowing conversion warnings (#20141) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-06-27 09:01:28 -07:00
Tyler Michael Smith 0bceac9810 Spam folks if config.py changes (#20131) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-06-26 08:19:46 -07:00
Tyler Michael SmithandVarun Sundar Rabindranath 68aaeb3749 [EP+DP] Optimize the little operations in the DeepGEMM + DeepEP low latency case (#19885) 
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
 2025-06-23 11:07:47 -07:00
Tyler Michael Smith d459fae0a2 [Bugfix][EP+DP] Fix internode check (#19112) 
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
 2025-06-04 23:39:23 +08:00
Tyler Michael Smith 8a57872b2a [Bugfix][EP+DP] Use pplx-kernel internode instead of intranode (#19034) 
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-06-03 11:36:51 +08:00
Tyler Michael SmithandLucas Wilkinson 6e588da0f4 [Build/CI] Fix CUDA 11.8 build (#17679) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
 2025-05-22 12:13:54 -07:00
Tyler Michael Smith f62cad6431 [Build/CI] Upgrade CUTLASS to 3.9.2 (#17641) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-05-04 19:23:17 -07:00
Tyler Michael Smith 68e1ee0072 [Bugfix][Easy] Fix whitespace in shm_broadcast.py logging (#17635) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-05-04 19:20:19 -07:00
Tyler Michael Smith c8386fa61d [Build/CI] Upgrade CUTLASS to 3.9.1 (#17602) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-05-02 22:25:14 -07:00
Tyler Michael Smith dbb036cf61 [Bugfix] Fix tests/kernels/test_mamba_ssm_ssd.py (#16623) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-04-15 05:35:38 +00:00
Tyler Michael Smith 23114d3364 [Misc] Warn about v0 in benchmark_paged_attn.py (#15495) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-03-25 20:31:04 -07:00
Tyler Michael Smith b5269db959 Revert "Fix non-contiguous input passed to Marlin kernel (#15319)" (#15398) 2025-03-24 20:43:51 -07:00
Tyler Michael SmithandDarkLight1337 e1eb45d397 [Bugfix] Fix precommit - line too long in pixtral.py (#14960) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-03-17 07:18:50 -07:00
Tyler Michael Smith ccf02fcbae Revert "[Model] Mamba2 Prefill Performance Tweaks: Fixing Flurry of U… (#14848) 2025-03-14 20:45:42 -07:00
Tyler Michael Smith ca7a2d5f28 Revert "[Perf] Reduce MLA CPU overheads in V1 (#14384)" (#14471) 2025-03-07 22:18:53 -08:00
Tyler Michael Smith 333681408f [Bugfix][V1] Handle MLA in kv_cache_interface (#14462) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-03-07 22:18:25 -08:00
Tyler Michael Smith 958adce478 [Bugfix] Fix use_direct_call condition in FusedMoE layer for (#14382) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-03-06 14:17:21 -08:00
Tyler Michael Smith 99b0915d3b [Kernel] Add needs_fixed_stride_order tag to most GEMMs (#14306) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-03-06 14:17:09 -08:00
Tyler Michael Smith cc2f9b32c8 [Distributed] Add enable_expert_parallel arg (#14305) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-03-06 18:54:45 +00:00
Tyler Michael Smith a7ea35aa67 [Bugfix] Remove num_tokens_across_dp (#14302) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-03-05 23:55:55 +00:00
Tyler Michael Smith 72c62eae5f [V1] EP/TP MoE + DP Attention (#13931) 2025-03-04 21:27:26 -08:00
Tyler Michael Smith 4f5b059f14 Clean up unused padding_idx variables across many model definitions (#13240) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-03-04 21:27:00 +00:00
Tyler Michael Smith 1e15aaef56 [Bugfix][Quantization] Fix FP8 + EP (#13784) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-02-25 10:54:17 +08:00
Tyler Michael Smith b3942e157e [Bugfix][CI][V1] Work around V1 + CUDA Graph + torch._scaled_mm fallback issue (#13425) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-02-18 00:32:48 +00:00
Tyler Michael SmithandYu Chin Fabian Lim 1f69c4a892 [Model] Support Mamba2 (Codestral Mamba) (#9292) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
 2025-02-17 20:17:50 +08:00
Tyler Michael Smith 97a3d6d995 [Bugfix] Massage MLA's usage of flash attn for RoCM (#13310) 2025-02-14 21:33:25 -08:00
Tyler Michael Smith 067678262a [Bugfix][CI] Inherit codespell settings from pyproject.toml in the pre-commit-config (#13237) 2025-02-13 20:19:43 -08:00
Tyler Michael Smith 09545c0a94 [Bugfix/CI] Turn test_compressed_tensors_2of4_sparse back on (#13250) 2025-02-13 20:19:25 -08:00
Tyler Michael Smith c1e37bf71b [Kernel][Bugfix] Refactor and Fix CUTLASS 2:4 Sparse Kernels (#13198) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-02-14 00:01:14 +00:00
Tyler Michael Smith c11de33dad [Bugfix][Kernel] Fix per-token/per-channel quantization for Hopper scaled mm (#12696) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-02-03 13:04:59 -08:00
Tyler Michael Smith cfa134d247 [Bugfix/CI] Fixup benchmark_moe.py (#12562) 
Fixes `is_marlin` not being passed into `get_default_config`

Also allow `--tensor-parallel-size` in addition to `-tp` and `--tp-size`

Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-02-01 13:41:35 +08:00
Tyler Michael Smith eb5741ad42 [Kernel][Quantization] Integrate block-quantized CUTLASS kernels for DeepSeekV3 (#12587) 
Integrates the block-quantized kernels introduced in
https://github.com/vllm-project/vllm/pull/11868 for use in linear
layers.

Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-01-31 15:29:11 -08:00
Tyler Michael Smith 73aa6cfdf7 Revert "[Build/CI] Fix libcuda.so linkage" (#12552) 2025-01-29 21:12:24 +00:00
Tyler Michael Smith 72bac73067 [Build/CI] Fix libcuda.so linkage (#12424) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-01-26 21:18:19 +00:00
Tyler Michael Smith 72f4880425 [Bugfix/CI] Fix broken kernels/test_mha.py (#12450) 2025-01-26 10:39:03 -08:00
Tyler Michael Smithandmgoin aa2cd2c43d [Bugfix] Disable w16a16 2of4 sparse CompressedTensors24 (#12417) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
 2025-01-26 19:59:58 +08:00
Tyler Michael Smith 615e4a5401 [CI] Turn on basic correctness tests for V1 (#10864) 2025-01-08 21:20:44 -05:00
Tyler Michael Smith 970d6d0776 [Build][Kernel] Update CUTLASS to v3.6.0 (#11607) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2024-12-30 17:22:13 +08:00
Tyler Michael Smith 5a9da2e6e9 [Bugfix][Build/CI] Fix sparse CUTLASS compilation on CUDA [12.0, 12.2) (#11311) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2024-12-19 02:43:30 +00:00
Tyler Michael Smith 2bfdbf2a36 [V1][Core] Use weakref.finalize instead of atexit (#11242) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2024-12-16 22:11:33 -08:00
Tyler Michael Smith ea7bd68d10 [V1][Bugfix] Fix V1 TP trust-remote-code (#11182) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2024-12-14 08:21:23 +00:00
Tyler Michael Smith 4b5b8a6a3b [V1][Bugfix] Fix EngineCoreProc profile (#11185) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2024-12-13 17:02:35 -08:00
Tyler Michael Smith 452a723bf2 [V1][Core] Remove should_shutdown to simplify core process termination (#11113) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2024-12-11 23:34:54 +00:00
Tyler Michael Smith 9a93973708 [Bugfix] Fix Mamba multistep (#11071) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2024-12-11 00:16:22 +00:00
Tyler Michael Smith 28b3a1c7e5 [V1] Multiprocessing Tensor Parallel Support for v1 (#9856) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2024-12-10 06:28:14 +00:00
Tyler Michael Smith d2bd88b122 [CI/Build] Replace mean with torch.all in test_pynccl.py (#10876) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2024-12-04 03:23:21 +00:00
Tyler Michael Smith e2251109c7 [Kernel] Remove if-else with identical branches in marlin 2:4 (#10687) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2024-11-26 22:55:32 -08:00
Tyler Michael Smith 978b39744b [Misc] Add pynccl wrappers for all_gather and reduce_scatter (#9432) 2024-11-22 22:14:03 -05:00
Tyler Michael Smith 2885ba0e24 [Misc] Change RedundantReshapesPass and FusionPass logging from info to debug (#10308) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2024-11-15 02:44:26 +00:00
Tyler Michael Smith ad23318928 [Bugfix] Fixup Mamba (#10004) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2024-11-05 03:46:38 +00:00
Tyler Michael Smith 04bbf38e05 [Core] Use os.sched_yield in ShmRingBuffer instead of time.sleep (#9994) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2024-11-05 01:08:21 +00:00
Tyler Michael Smith e5ac6a4199 [Bugfix] Fix divide by zero when serving Mamba models (#9617) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2024-10-23 16:40:43 +00:00
Tyler Michael Smith ae8b633ba3 [Bugfix] Fix offline_inference_with_prefix.py (#9505) 2024-10-18 16:59:19 +00:00
Tyler Michael Smith c3fab5f769 [Bugfix][Kernel] Prevent integer overflow in fp8 dynamic per-token quantize kernel (#9425) 2024-10-16 23:46:06 +00:00
Tyler Michael Smith 169b530607 [Bugfix] Clean up some cruft in mamba.py (#9343) 2024-10-15 00:24:25 +00:00
Tyler Michael Smith 16b24e7dcd [Bugfix] Bandaid fix for speculative decoding tests (#9327) 2024-10-13 23:02:11 +00:00
Tyler Michael Smith 7342a7d7f8 [Model] Support Mamba (#6484) 2024-10-11 15:40:06 +00:00
Tyler Michael Smith 2e7fe7e79f [Build/CI] Set FETCHCONTENT_BASE_DIR to one location for better caching (#8930) 2024-09-29 03:13:01 +00:00
Tyler Michael Smith 71d21c73ab [Bugfix] Fixup advance_step.cu warning (#8815) 2024-09-26 16:23:45 -07:00
Tyler Michael Smith e2f6f26e86 [Bugfix] Fix print_warning_once's line info (#8867) 2024-09-26 16:18:26 -07:00
Tyler Michael Smith f70bccac75 [Build/CI] Upgrade to gcc 10 in the base build Docker image (#8814) 2024-09-26 10:07:18 -07:00
Tyler Michael Smith 3dda7c2250 [Bugfix] Avoid some bogus messages RE CUTLASS's revision when building (#8702) 2024-09-22 22:24:59 -04:00
Tyler Michael Smith d66ac62854 [Kernel][Bugfix] Delete some more useless code in marlin_moe_ops.cu (#8643) 2024-09-21 23:45:02 +00:00
Tyler Michael Smithand 4c34ce8916 [Kernel] Remove marlin moe templating on thread_m_blocks (#8573) 
Co-authored-by: lwilkinson@neuralmagic.com
 2024-09-19 01:42:49 +00:00
Tyler Michael Smith db9120cded [Kernel] Change interface to Mamba selective_state_update for continuous batching (#8039) 2024-09-18 20:05:06 +00:00
Tyler Michael Smith 8110e44529 [Kernel] Change interface to Mamba causal_conv1d_update for continuous batching (#8012) 2024-09-17 23:44:27 +00:00
Tyler Michael Smith 94144e726c [CI/Build][Kernel] Update CUTLASS to 3.5.1 tag (#8043) 2024-09-10 23:51:58 +00:00
Tyler Michael Smith 4cf1dc39be [Bugfix][CI/Build] Fix CUTLASS FetchContent (#7171) 2024-08-05 14:22:57 -07:00
Tyler Michael Smith 6e4852ce28 [CI/Build] Suppress divide-by-zero and missing return statement warnings (#7001) 2024-08-05 16:00:01 -04:00
Tyler Michael Smith 8571ac4672 [Kernel] Update CUTLASS to 3.5.1 (#7085) 2024-08-05 15:13:43 -04:00
Tyler Michael Smith 6a11fdfbb8 [CI/Build][Bugfix] Fix CUTLASS header-only line (#7034) 2024-08-01 13:51:15 -07:00
Tyler Michael Smith d7a299edaa [Kernel] Remove scaled_fp8_quant kernel padding footgun (#6842) 2024-07-30 16:37:01 -04:00
Tyler Michael Smith cbbc904470 [Kernel] Squash a few more warnings (#6914) 2024-07-30 13:50:42 -04:00