Lukas Geiger e7523c2e03 [V1][Sampler] Improve performance of FlashInfer sampling by sampling logits instead of probs (#18608)

2025-05-26 11:49:36 -04:00

..

attention

[v1] Redo "Support multiple KV cache groups in GPU model runner (#17945)" (#18593)

2025-05-23 09:39:47 -07:00

core

[BugFix][Spec Decode] Improve Prefix Caching Logic in Speculative Decoding (#18668)

2025-05-24 17:33:46 -07:00

engine

[V1] Fix _pickle.PicklingError: Can't pickle <class 'transformers_modules.deepseek-ai.DeepSeek-V2-Lite... (#18640)

2025-05-24 20:07:20 -07:00

executor

[BugFix] Increase TP execute_model timeout (#18558)

2025-05-23 10:22:11 +08:00

metrics

[Misc] Add Ray Prometheus logger to V1 (#17925)

2025-05-16 01:02:42 -07:00

sample

[V1][Sampler] Improve performance of FlashInfer sampling by sampling logits instead of probs (#18608)

2025-05-26 11:49:36 -04:00

spec_decode

[V1][Spec Decode] Support multi-layer eagle draft model (#18030)

2025-05-24 09:45:34 +00:00

structured_output

[Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454)

2025-05-23 16:16:26 -07:00

worker

[V1][Spec Decode] Support multi-layer eagle draft model (#18030)

2025-05-24 09:45:34 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

kv_cache_interface.py

[v1] Redo "Support multiple KV cache groups in GPU model runner (#17945)" (#18593)

2025-05-23 09:39:47 -07:00

outputs.py

[P/D] NIXL Integration (#17751)

2025-05-12 09:46:16 -07:00

request.py

[Feature][V1]: suupports cached_tokens in response usage (#18149)

2025-05-23 01:41:03 -07:00

serial_utils.py

[V1] Improve VLLM_ALLOW_INSECURE_SERIALIZATION logging (#17860)

2025-05-08 16:57:35 +00:00

utils.py

[V1] DP scale-out (2/N): Decouple engine process management and comms (#15977)

2025-05-13 10:48:21 -07:00