Lukas Geiger e7523c2e03 [V1][Sampler] Improve performance of FlashInfer sampling by sampling logits instead of probs (#18608)

2025-05-26 11:49:36 -04:00

..

ops

[V1][Sampler] Improve performance of FlashInfer sampling by sampling logits instead of probs (#18608)

2025-05-26 11:49:36 -04:00

tpu

[TPU][V1] Add support for top-logprobs (#17072)

2025-05-05 14:20:15 -07:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

metadata.py

[V1] Support bad_words in sampler (#13376)

2025-03-08 14:50:26 -08:00

rejection_sampler.py

[Bugfix] Fix triton import with local TritonPlaceholder (#17446)

2025-05-06 17:53:09 +08:00

sampler.py

[Bugfix] Validate logit biases to prevent out of vocab ids crashing engine (#16529)

2025-04-12 20:19:19 +00:00