iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
23,262 Commits 3 Branches 0 Tags
2b85d9cb65c1f56c347cb7f56f1596a6b8b28373
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Kevin H. LuuClaude Opus 5.5Wei Zhao
 		2b85d9cb65 [Perf][Bugfix] Prefer MNNVL for single-node FlashInfer allreduce again (#61989) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
 2026-10-17 02:55:28 -07:00
Kevin H. LuuClaude Opus 5.5Jee Jee Livllm-agent
 		08a65e287e [Bugfix][Kernel] hadacore: don't load past the input on a partial last warp (#61944) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: vllm-agent <claw@inferact.ai>
 2026-10-17 00:52:17 -07:00
Kevin H. LuuandClaude Opus 5.5 a956a8126e [Bugfix][MoE] Keep the gate's hash_indices_table out of RoutedExperts parameters (#61930) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-15 18:00:17 -07:00
Kevin H. LuuClaude Opus 5.5Cyrus Leung
 		b7b20b1b8f [Bugfix][Frontend] Leave the final stop token out of chat derender text (#61757) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-10-15 21:51:34 +08:00
Kevin H. LuuandClaude Opus 5.5 7f730b4cea [CI] Run 4xH100 steps nightly only (#61782) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-15 01:32:43 -07:00
Kevin H. LuuandClaude Opus 5.5 8f111b22ee [CI] Run 4xB200 steps nightly only (#61541) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-15 00:08:48 -07:00
Kevin H. LuuandClaude Opus 5.5 32feecd91f [CI] Pin DeepSeek-V4.1-Flash-NVFP4 eval to its FP8-Engram revision (#61763) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-15 00:05:18 -07:00
Kevin H. LuuOpenAI CodexClaude Opus 5.5
 		a400804ce4 [CI] Relax MTP sharded sampling cross-boot noise bound (#57026) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-14 22:31:45 -07:00
Kevin H. Luu 4b61f300c0 [CI] Fix /ci run reporting a failed merge on fork PRs (#61684) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-10-14 15:26:15 -07:00
Kevin H. LuuandOpenAI Codex 0b6d07cbe2 [CI/Build] Use FileStore for DeepEP test rendezvous (#56595) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-10-14 14:29:12 -04:00
Kevin H. LuuandMisha Goin d36158f919 [CI] Merge the target branch into stale PRs on /ci run (#61592) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
 2026-10-14 01:43:03 -07:00
Kevin H. LuuClaude Opus 5.5Bugen Zhao
 		ec317a4618 [CI] Keep vLLM log propagation on through the first LLM init in caplog_vllm (#61535) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
 2026-10-14 15:10:35 +08:00
Kevin H. LuuandCodex d5e62627a3 [CI] Shard chat APIs, model evals and model tests automatically (#61475) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-10-13 18:16:27 -07:00
Kevin H. LuuandCodex 6a03954b45 [CI] Shard quantization, pooling, multimodal APIs, core kernels and PCP eval automatically (#61477) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-10-13 16:15:30 -07:00
Kevin H. LuuandCodex 0da66a6e46 [CI] Shard batch invariance, Kimi prefix cache, EP eval and generate APIs automatically (#61474) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-10-13 16:14:18 -07:00
Kevin H. LuuandClaude Opus 5.5 206e45d470 [CI] Shard V1 Attention automatically instead of by fixed pytest shards (#61200) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-13 02:24:06 -07:00
Kevin H. LuuandClaude Opus 5.5 4e4eab73ed [CI] Shard Model Executor and L4 Pipeline + Context Parallelism automatically (#61202) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-12 23:57:32 -07:00
Kevin H. LuuandClaude Opus 5.5 783ac12071 [CI] Accept whitespace around /ci commands and reply instead of going silent (#60925) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-09 15:43:37 -07:00
Kevin H. LuuandClaude Opus 5.5 24be8c0bca [CI] Remove dead in-tree TPU (torch_xla) CI scripts (#60591) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-08 02:42:07 -07:00
Kevin H. LuuandClaude Opus 5.5 c4cd88d9fe [CI] Make (H100) Distributed DP + EP optional (#60540) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-08 02:31:13 -07:00
Kevin H. LuuandSherlock 1283362e76 [CI] Add headroom and selection coverage for H200 fast lanes (#56775) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Sherlock <sherlock@raft.ai>
 2026-10-07 17:17:56 -07:00
Kevin H. LuuandClaude Opus 5.5 02d8a94e61 [CI][ROCm] Skip DSv4.1 decoder replay graph test on ROCm (#60378) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-07 02:38:31 -07:00
Kevin H. LuuandClaude Opus 5.5 4b4eb6277a [CI] Remove AMD mirror of CPU-only Rust frontend cargo steps (#60323) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-06 18:30:52 -07:00
Kevin H. LuuClaude Opus 5.5Andreas Karatzas
 		ae19af883a [CI] Require transformers 5.19 for the EmbeddingGemma2 registry test (#60295) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-10-06 14:50:10 -07:00
Kevin H. LuuandClaude Opus 5.5 89a00995c9 [CI] Read each profiler round's trace as it stops in test_gpu_profiler (#59769) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-05 15:25:11 -07:00
Kevin H. LuuandClaude Opus 5.5 1a001d5842 [CI] Drop duplicate bf16 skinny GEMM test from Kimi K3 B200 job (#59850) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-02 21:43:05 -07:00
Kevin H. Luu 5b6b657e13 [ci] Update mergify to rebase if behind by 100 commits (#59710) 
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
 2026-10-01 17:17:37 -07:00
Kevin H. LuuandClaude Opus 5.5 8bc31bd210 [CI] Deflake the multi-API-server metrics test and Mooncake PD ports (#59507) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-30 17:22:58 -07:00
Kevin H. LuuandCodex bec710fccf [CI] Fix mock type narrowing in LoRA serving test (#59344) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-29 19:55:04 -07:00
Kevin H. LuuandClaude Opus 5.5 aedaba8664 [CI/Build] Skip the snapshot runtime on CUDA 12.x images (#59118) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-28 20:17:59 -07:00
Kevin H. LuuClaude Opus 5.5Lucas WilkinsonNick Hill
 		764413559a [Bugfix] Don't sync-police or retry FlashInfer all-reduce workspace creation in eager mode (#58498) 
Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-09-28 12:14:21 -07:00
Kevin H. LuuandClaude Opus 5.5 252279314b Revert "[CI] Shard (H200 MIG 35GB / MI355 DPX) Entrypoints Integration (Pooling) into named jobs (#58652)" (#59011) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-28 03:51:17 -07:00
Kevin H. LuuandClaude Opus 5.5 0da126676e [Bugfix] Fix the two multimodal root tests that fail on main (OpenPangu-VL embed merge, MiMo sink test fixture) (#58900) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-28 04:52:51 +00:00
Kevin H. Luu 7d8c5fe9a9 [Bugfix][DSV4.1] Avoid host sync in ViT CUDA graph replay metadata (#58499) 2026-09-26 11:37:36 -04:00
Kevin H. LuuClaude Opus 5.5Misha Goin
 		155b988373 [CI] Run DFlash2 NVFP4 acceptance test on B200; skip it on H200 35GB MIG (#58496) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
 2026-09-24 19:29:44 -06:00
Kevin H. LuuandClaude Opus 5.5 7ef0d69ea0 [5/12][ci-selector][CI] Skip the Proton GPU test when another CUPTI tool is injected (#58455) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-23 17:25:41 -07:00
Kevin H. LuuandClaude Opus 5.5 21ee743f47 [CI][Bugfix] Limit MRV2 sampler JIT warmup registration to ROCm (#58465) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-23 16:11:50 -07:00
Kevin H. LuuandClaude Fable 5.1 64a48b19b4 [CI] Emit a kernel symbol map from the csrc build (opt-in, for test selection) (#58097) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-22 01:37:34 -07:00
Kevin H. LuuOpenAI CodexJee Jee Li
 		eb87980585 [Build] Fix DeepGEMM CUDA 12.9 release builds (#57554) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-09-20 20:14:00 -07:00
Kevin H. LuuandKimi 9d75dd4544 [CI] Deflake pooling shards with GPU teardown fixtures between tests (#57371) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
 2026-09-19 11:30:02 +08:00
Kevin H. Luu 2fd6268e6d [CI] Deflake MTEB score tests with per-model mteb_tol and reruns (#57364) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-09-19 11:29:00 +08:00
Kevin H. Luu 729ebac498 [CI] Reclaim GPU memory between model initialization tests (#57362) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-09-18 17:04:14 -07:00
Kevin H. Luu 04a3a00eb7 [CI] Raise GSM8K startup max wait to 2400s for flaky 30B+ MoE eval configs (#57361) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-09-18 03:40:54 -07:00
Kevin H. LuuandKimi f2b6152ec2 [CI] Add flaky rerun markers / timeout skips to sibling tests lacking them (#57359) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
 2026-09-18 03:40:32 -07:00
Kevin H. LuuandOpenAI Codex 5397f967b9 [CI] Add residual timeout headroom after JIT rollback (#56649) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-18 03:11:07 -07:00
Kevin H. Luu f46968cb6e [CI] Make ci-clean-log.sh portable to macOS/BSD sed (#57367) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-09-17 12:42:59 +00:00
Kevin H. LuuandKimi 99ea5f525d [CI] Raise DSv4-Flash disaggregated engine readiness timeout to 1800s (#57334) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
 2026-09-17 03:34:00 -07:00
Kevin H. LuuandKimi 683f6c8edf [CI] Raise H200 LM Eval Large Models timeout to 120 min (#57335) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi <noreply@moonshot.cn>
 2026-09-17 03:33:44 -07:00
Kevin H. Luu 0bfc7a15d0 [CI] Fix ruff docstring violations in EC connector files (#57283) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-09-16 21:13:15 -07:00
Kevin H. LuuSherlockmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		af1c01499b [Bugfix] Make GPU sync checks safe under torch.compile (#56904) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Sherlock <sherlock@raft.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-15 21:37:08 -07:00
Kevin H. Luu 2f46a1d9c6 [CI] Keep Qwen3 Omni DSpark config fixture complete (#57044) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
 2026-09-15 18:19:14 +00:00
Kevin H. LuuCodexTyler Michael SmithJason Yao
 		241e9391ed [Bugfix][Attention] Stabilize sparse-MLA DCP for GLM PCP evals (#55879) 
Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Jason Yao <wsyjh8@gmail.com>
 2026-09-15 09:58:30 -07:00
Kevin H. Luu 2983fc6286 [CI] Fix NIXL push worker test stub after failure deferral (#56955) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
 2026-09-15 02:00:58 -07:00
Kevin H. LuuandSherlock 2e2fdaa99a [CI] Extend Arm CPU kernel shard timeout (#56601) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Sherlock <sherlock@openai.com>
 2026-09-15 01:00:40 -07:00
Kevin H. Luu ec6b14c044 [CI] Select the supported DCP backend for PCP eval (#56677) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
 2026-09-14 23:05:59 -07:00
Kevin H. LuuandOpenAI Codex 7b7e117c29 [CI] Extend DSv4 engine readiness timeout on main (#56735) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-09-14 21:54:57 -07:00
Kevin H. LuuOpenAI CodexTyler Michael Smith
 		caf56ce9da [CI] Pass the scale-out endpoint flag in EC E2E (#56819) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2026-09-15 12:25:30 +08:00
Kevin H. LuuandOpenAI Codex a491b6039d [CI] Drop root privileges for the OTel GPU sampler (#56941) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-14 21:20:14 -07:00
Kevin H. LuuOpenAI CodexSherlockOpenAI Codex
 		8765952755 [CI/Build] Retry CPU image stream interruptions (#56597) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Sherlock <sherlock@openai.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-09-14 21:18:10 -07:00
Kevin H. LuuandOpenAI Codex 772e4f05fa [Bugfix][Rust] Fix HF multi-turn dataset integration (#56915) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-14 18:04:46 -07:00
Kevin H. LuuandSherlock d320a21431 [Bugfix][Rust Frontend] Restore prost test dependency (#56866) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: Sherlock <sherlock@raft.ai>
 2026-09-14 14:37:44 -07:00
Kevin H. LuuandOpenAI Codex 56ca9904ce [CI] Initialize ubatch runner in cudagraph unit test (#56808) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-14 13:37:08 -05:00
Kevin H. LuuandOpenAI Codex 5236bef721 [CI] Keep OTel bytecode out of mounted checkouts (#56766) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-14 02:52:45 -07:00
Kevin H. LuuandOpenAI Codex dc36fcce90 [CI] Collect GPU memory telemetry for MIG slices (#56747) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-13 21:30:29 -07:00
Kevin H. LuuandOpenAI Codex 214248c7d8 [CI] Move smaller H200 workloads to 18GB MIG slices (#56695) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-13 21:30:11 -07:00
Kevin H. Luu 2d9c30a7b5 [CI][Bugfix] Complete FSE fixture R-SWA contract (#56710) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
 2026-09-14 03:30:25 +00:00
Kevin H. Luu dec0b5d63f [Bugfix] Skip Triton autotune inspection without Triton (#56676) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
 2026-09-13 17:05:29 +00:00
Kevin H. LuuandOpenAI Codex 1ee4be4dbc [CI] Update DeepSeek V4.1 MegaMoE routing test (#56599) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-12 11:31:13 -07:00
Kevin H. LuuandOpenAI Codex fd7cd4b883 [CI] Fix Qwen3 Omni DSpark load test config (#56600) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-12 11:29:58 -07:00
Kevin H. LuuandOpenAI Codex d86257e283 [CI/Build] Give the Torch ABI audit time to start (#56596) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-09-12 03:29:22 -07:00
Kevin H. LuuandCodex 33fa95a0cf [CI] Sample GPU utilization and memory alongside test timelines (#56541) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-12 02:41:54 -07:00
Kevin H. LuuandOpenAI Codex 1cf6555214 [Bugfix] Pin EPLB and MLA host-to-device transfer buffers (#56138) 
Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-09-11 01:57:47 -07:00
Kevin H. LuuCodexWentao Yemergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		5acd95906b [Bugfix] Exclude DP token padding from draft attention metadata (#55458) 
Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-09 01:47:45 -07:00
Kevin H. Luu 05e52f6336 [CI] Fix ARM64 test dependency builds with GCC 15 (#55877) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-09-08 14:27:13 -07:00
Kevin H. LuuKimi CodeCodex
 		808353f477 [CI] Split long misc test groups by command (#52346) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-08 13:44:14 -07:00
Kevin H. Luu 34b9899c8f [CI] Increase ColQwen3 pooling test memory budget on H200 MIG (#55878) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-09-08 11:39:01 +00:00
Kevin H. LuuandCodex 5db652225f [Bugfix] Validate extension integers before engine serialization (#55606) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-08 16:30:06 +08:00
Kevin H. LuuandCodex 96eccb8f49 [CI] Restore clean GPU state before OAI Triton MoE tests (#55453) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-08 01:15:21 -07:00
Kevin H. LuuandCodex 537af2c3a4 [CI] Recover empty multi-node Docker networks and finish partial cleanup (#55454) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-07 12:53:13 -07:00
Kevin H. LuuandCodex 58f09211dd [CI] Synchronize shared offload unlink test before observing pathname (#55604) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-07 12:52:36 -07:00
Kevin H. LuuandCodex 6865e67f0b [Bugfix] Defer adaptive verification until after kernel warmup (#55455) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-06 11:31:40 -07:00
Kevin H. LuuandCodex 722d169339 [CI] Align extraction test with canonical auxiliary layer order (#55457) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-06 11:22:14 -07:00
Kevin H. Luu 5e4e927b5e [CI] Force HTTP/1.1 for runtime Git installs (#55044) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
 2026-09-03 10:14:22 +08:00
Kevin H. LuuandKimi Code 6c6376a09e [CI] Remove deleted nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 and its arch aliases (#55026) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Kimi Code <noreply@moonshot.cn>
 2026-09-02 15:18:46 -07:00
Kevin H. Luu 963054ed58 [CI] Exclude nightly-dev tags from nightly DockerHub cleanup (#55023) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-09-02 15:09:18 -07:00
Kevin H. Luu 76ba32160a [CI] Shard CPU jobs above the 24h P90 threshold (#54751) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
 2026-09-02 02:16:05 -07:00
Kevin H. Luu f5711fa138 [CI] Shard LoRA TP distributed tests (#52350) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
 2026-09-02 01:16:44 -07:00
Kevin H. Luu 878ec4bfee [CI] Shard entrypoints API-server tests (#52344) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
 2026-09-02 01:13:38 -07:00
Kevin H. Luu 1b4b2a18b8 [CI] Shard H100 MoE refactor integration tests (#52352) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
 2026-09-02 01:10:14 -07:00
Kevin H. Luu 3976eada8b [CI] Use PR head label for Buildkite branch to avoid main collision (#54895) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-09-01 23:09:50 -07:00
Kevin H. Luu 05201d8ecf [CI] Shard basic model initialization tests (#54753) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
 2026-09-02 04:31:57 +00:00
Kevin H. LuuCodexYongye Zhu
 		46c8a161f4 [Bugfix] Handle padded routes in CUTLASS MoE permutations (#54747) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-09-01 19:08:17 -07:00
Kevin H. Luu 3b6c0bdae9 [CI] Shard long kernel test groups (#54754) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
 2026-09-01 15:58:27 -07:00
Kevin H. Luu 96031b8623 [CI] Shard distributed model jobs above the 24h P90 threshold (#54752) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
 2026-09-01 15:32:11 -07:00
Kevin H. Luu e90b608c42 [CI] Split nightly MTP acceptance tests (#52353) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
 2026-09-01 15:29:33 -07:00
Kevin H. Luu 4bf06be985 [CI] Disable CUDA graphs for GLM PCP evals (#54745) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
 2026-09-01 20:24:46 +00:00
Kevin H. LuuandCodex 504bb8b0c3 [CI] Add repository-local OTel tracing helpers (#52851) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-01 02:36:46 -07:00
Kevin H. Luu 24d42f3553 [CI] Mark 1-GPU L4 test steps with device: l4 for EKS migration (#54549) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-08-31 14:56:27 -07:00
Kevin H. Luu 7a100bb617 [CI] Restore gpu_1_queue routing for torch-abi audit (#54468) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-08-30 14:59:36 -07:00
Kevin H. Luu b2dc864bb6 [Bugfix][Spec Decode] Keep default CUDA graph sizes memory-safe (#54418) 
Signed-off-by: Kevin Luu <51931015+khluu@users.noreply.github.com>
 2026-08-30 18:02:31 +00:00