iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
Files
9909726d2a30d834d97efd7bf1c4fc0e52fa48b5
vLLM/vllm
T
History
czhu-cohere 9909726d2a Enable ZP Support for Machete (#20268) 
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
2025-07-01 07:12:20 +00:00
..
adapter_commons
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
assets
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
attention
Quick Fix by adding conditional import for flash_attn_varlen_func in flash_attn (#20143)
2025-06-27 05:48:13 +00:00
benchmarks
[Benchmark][Bug] Fix multiple bugs in bench and add args to spec_decode offline (#20083)
2025-06-25 22:06:27 -07:00
compilation
use .dev for version comparison with pytorch nightly release (#20031)
2025-06-24 21:52:16 +00:00
core
[Core] add remove_seq_from_computed_blocks_tracker to BlockSpaceManager (#19686)
2025-06-17 04:40:58 +00:00
device_allocator
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
distributed
[V1] Only print cudagraph tqdm on rank 0 with is_global_first_rank (#19516)
2025-07-01 06:02:09 +00:00
engine
[CLI] Improve CLI arg parsing for -O/--compilation-config (#20156)
2025-07-01 01:03:13 +00:00
entrypoints
[Bugfix] Fix include prompt in stream response when echo=true (#15233)
2025-07-01 01:30:14 +00:00
executor
[Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560)
2025-06-26 09:27:18 -07:00
inputs
[Core] [Bugfix] [Multimodal] Fix multimodal profiling and generation for SFT/PTQed models (#20058)
2025-06-30 17:26:49 +00:00
logging_utils
[BugFix] Don't catch BaseException when dumping execute_model errors (#19626)
2025-06-16 11:01:08 +00:00
lora
[CI] change spell checker from codespell to typos (#18711)
2025-06-11 19:57:10 -07:00
model_executor
Enable ZP Support for Machete (#20268)
2025-07-01 07:12:20 +00:00
multimodal
[Core] [Bugfix] [Multimodal] Fix multimodal profiling and generation for SFT/PTQed models (#20058)
2025-06-30 17:26:49 +00:00
platforms
[Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560)
2025-06-26 09:27:18 -07:00
plugins
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
profiler
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
prompt_adapter
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
reasoning
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
spec_decode
[Core] Cast multimodal input in hf processor (#18862)
2025-06-03 20:24:56 -07:00
third_party
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
transformers_utils
[CI] change spell checker from codespell to typos (#18711)
2025-06-11 19:57:10 -07:00
triton_utils
[Chore] dedup logs (#19955)
2025-06-22 19:43:07 +00:00
usage
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
v1
[V1] Only print cudagraph tqdm on rank 0 with is_global_first_rank (#19516)
2025-07-01 06:02:09 +00:00
vllm_flash_attn
[BugFix] Fix vllm_flash_attn install issues (#17267)
2025-04-27 17:27:56 -07:00
worker
[Misc] add vllm_config in __init__ (#19866)
2025-06-21 23:10:46 -04:00
__init__.py
[Perf][CLI] Improve overall startup time (#19941)
2025-06-22 23:11:22 +00:00
_custom_ops.py
Fix num_token_padding support for static per-tensor scaled_fp8_quant (#20188)
2025-06-27 22:48:13 -07:00
_ipex_ops.py
[Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560)
2025-06-26 09:27:18 -07:00
beam_search.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
collect_env.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
config.py
[CLI] Improve CLI arg parsing for -O/--compilation-config (#20156)
2025-07-01 01:03:13 +00:00
connections.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
env_override.py
[Misc] Reduce warning message introduced in env_override (#19476)
2025-06-11 17:29:54 +08:00
envs.py
[Feature] add quick all reduce (#19744)
2025-06-26 20:54:24 -07:00
forward_context.py
[CUDA] Enable full cudagraph for FlashMLA (#18581)
2025-06-13 18:12:26 +00:00
jsontree.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
logger.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
logits_process.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
outputs.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
pooling_params.py
Support embedding models in V1 (#16188)
2025-06-18 21:36:33 -07:00
py.typed
Add py.typed so consumers of vLLM can get type checking (#1509)
2023-10-30 14:50:47 -07:00
sampling_params.py
[Frontend] Expose custom args in OpenAI APIs (#16862)
2025-06-18 17:41:11 -07:00
scalar_type.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
scripts.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
sequence.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
test_utils.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
tracing.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
utils.py
[CLI] Improve CLI arg parsing for -O/--compilation-config (#20156)
2025-07-01 01:03:13 +00:00
version.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00