iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
Files
93aee29fdb81fa51d5d44f34ea84df80d0764235
vLLM/vllm
T
History
jvlunteren ccd7c05089 [Kernel] Add Split-KV Support to Unified Triton Attention Kernel (#19152) 
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
2025-06-17 10:45:07 +00:00
..
adapter_commons
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
assets
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
attention
[Kernel] Add Split-KV Support to Unified Triton Attention Kernel (#19152)
2025-06-17 10:45:07 +00:00
benchmarks
[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets (#18847)
2025-06-12 10:30:56 -07:00
compilation
[CUDA] Enable full cudagraph for FlashMLA (#18581)
2025-06-13 18:12:26 +00:00
core
[Core] add remove_seq_from_computed_blocks_tracker to BlockSpaceManager (#19686)
2025-06-17 04:40:58 +00:00
device_allocator
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
distributed
[Fix] Fall back to Gloo when NCCL backend is unavailable (#19641)
2025-06-17 08:42:14 +08:00
engine
[CPU] Refine default config for the CPU backend (#19539)
2025-06-13 13:27:39 +08:00
entrypoints
[Frontend] add chunking audio for > 30s audio (#19597)
2025-06-17 11:34:00 +08:00
executor
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
inputs
[Bugfix] Fix auto dtype casting for BatchFeature (#19316)
2025-06-14 15:13:08 +00:00
logging_utils
[BugFix] Don't catch BaseException when dumping execute_model errors (#19626)
2025-06-16 11:01:08 +00:00
lora
[CI] change spell checker from codespell to typos (#18711)
2025-06-11 19:57:10 -07:00
model_executor
[DOC] fix doc typos (#19600)
2025-06-17 11:34:53 +08:00
multimodal
[CI] change spell checker from codespell to typos (#18711)
2025-06-11 19:57:10 -07:00
platforms
[Misc] Remove duplicate multiproc method setting for CPU platform (#19649)
2025-06-16 02:26:58 +00:00
plugins
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
profiler
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
prompt_adapter
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
reasoning
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
spec_decode
[Core] Cast multimodal input in hf processor (#18862)
2025-06-03 20:24:56 -07:00
third_party
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
transformers_utils
[CI] change spell checker from codespell to typos (#18711)
2025-06-11 19:57:10 -07:00
triton_utils
[Bugfix] Don't attempt to use triton if no driver is active (#19561)
2025-06-14 12:30:54 -07:00
usage
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
v1
Fixes IMA for TP w/ flex-attention (#19712)
2025-06-17 04:01:50 +00:00
vllm_flash_attn
[BugFix] Fix vllm_flash_attn install issues (#17267)
2025-04-27 17:27:56 -07:00
worker
[CI] change spell checker from codespell to typos (#18711)
2025-06-11 19:57:10 -07:00
__init__.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
_custom_ops.py
[Kernel] GGUF MMVQ kernel for multiple input vectors (#18754)
2025-06-16 17:33:26 +08:00
_ipex_ops.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
beam_search.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
collect_env.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
config.py
[MISC] typo fix (#19672)
2025-06-16 07:18:49 +00:00
connections.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
env_override.py
[Misc] Reduce warning message introduced in env_override (#19476)
2025-06-11 17:29:54 +08:00
envs.py
[Misc] Turn MOE_DP_CHUNK_SIZE into an env var (#19506)
2025-06-12 18:01:16 +00:00
forward_context.py
[CUDA] Enable full cudagraph for FlashMLA (#18581)
2025-06-13 18:12:26 +00:00
jsontree.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
logger.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
logits_process.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
outputs.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
pooling_params.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
py.typed
Add py.typed so consumers of vLLM can get type checking (#1509)
2023-10-30 14:50:47 -07:00
sampling_params.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
scalar_type.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
scripts.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
sequence.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
test_utils.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
tracing.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
utils.py
[Bugfix] Fix auto dtype casting for BatchFeature (#19316)
2025-06-14 15:13:08 +00:00
version.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00