Gabriel Wu 8fa36fbbeb [Bugfix] FLASHINFER_MLA_SPARSE_SM120 compatibility with GLM-5 NVFP4 (#46506)

2026-06-25 09:12:00 -07:00

..

attention

[Bugfix] FLASHINFER_MLA_SPARSE_SM120 compatibility with GLM-5 NVFP4 (#46506)

2026-06-25 09:12:00 -07:00

core

[Core] Avoid mixed length specdec batches via padding (#45237)

2026-06-25 08:34:44 -07:00

engine

Chore: Fix minor doc sentence, grammar, quote errors (#40469)

2026-06-24 18:58:24 +00:00

executor

Stop setting CUDA_VISIBLE_DEVICES internally in vLLM, add device_ids arg (#45026)

2026-06-20 13:38:10 -07:00

kv_offload

[KV Offload] Use background thread for mmap / cpu_tensors pinning (#45850)

2026-06-24 18:13:27 +03:00

metrics

[Migration] Migrate GGUF quantization support to plugin (#39612)

2026-06-12 12:02:21 -07:00

pool

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

sample

[Bugfix][Model Runner V2][Spec Decode] Fix int32 offset overflow in sampler kernels (#46560)

2026-06-24 11:00:57 -07:00

simple_kv_offload

[SimpleCPUOffloadConnector] Fix remaining global→block conversions under PCP/DCP (#46394)

2026-06-24 23:05:24 -07:00

spec_decode

[CPU][Spec Decode] Enable DFlash SD for CPU (#44029)

2026-06-25 15:32:48 +08:00

structured_output

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

worker

[CPU][Spec Decode] Enable DFlash SD for CPU (#44029)

2026-06-25 15:32:48 +08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

kv_cache_interface.py

[Feature] Triton INT4 per-token-head KV cache quantization (#40835)

2026-06-24 10:21:25 +00:00

kv_cache_spec_registry.py

[KVCache] Support Pluggable KVCacheSpec (#37505)

2026-06-03 09:05:16 -07:00

outputs.py

[Core] Cleanup KVConnector handling with PP + fix MRV2 (#43732)

2026-05-28 13:12:03 -07:00

request.py

[Bugfix] Defer block freeing until in-flight steps finish under async scheduling + PD KV consumer (#45357)

2026-06-15 21:36:09 +00:00

serial_utils.py

[Core] Ensure memory is pinned prior to async h2d copy (#45424)

2026-06-20 20:02:24 -07:00

utils.py

[Rust Frontend] Forward VLLM_ENGINE_READY_TIMEOUT_S via --args-json (#44610)

2026-06-25 07:25:08 +00:00