Chenyaaangandrshaw@neuralmagic.com <robertgshaw2@gmail.com> ac3cd6e83c [core] add bucket padding to tpu_model_runner (#14995) ...

Signed-off-by: Chenyaaang <llccyy1212@gmail.com>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Co-authored-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>

2025-03-25 17:27:22 -04:00

..

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

gpu_input_batch.py

[V1] Aggregate chunked prompt logprobs in model runner (#14875)

2025-03-24 12:27:57 -04:00

gpu_model_runner.py

[V1][Spec Decode] Update target_logits in place for rejection sampling (#15427)

2025-03-24 21:04:41 -07:00

gpu_worker.py

[v1] Refactor KVCacheConfig (#14079)

2025-03-21 04:56:27 -07:00

lora_model_runner_mixin.py

[Kernels] LoRA - Retire SGMV and BGMV Kernels (#14685)

2025-03-18 09:47:53 +00:00

tpu_model_runner.py

[core] add bucket padding to tpu_model_runner (#14995)

2025-03-25 17:27:22 -04:00

tpu_worker.py

[Hardware][TPU][Bugfix] Fix v1 mp profiler (#15409)

2025-03-25 01:43:00 -07:00

worker_base.py

[v1] Refactor KVCacheConfig (#14079)

2025-03-21 04:56:27 -07:00