youkaichao 310aca88c9 [perf]fix current stream (#11870) ...

Signed-off-by: youkaichao <youkaichao@gmail.com>

2025-01-09 07:18:21 +00:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

cache_engine.py

[Model] PP support for Mamba-like models (#10992)

2024-12-10 21:53:37 -05:00

cpu_enc_dec_model_runner.py

[Bugfix] multi_modal_kwargs broadcast for CPU tensor parallel (#10541)

2024-11-22 21:25:46 -08:00

cpu_model_runner.py

[Bugfix][Hardware][CPU] Fix CPU input_positions creation for text-only inputs with mrope (#11434)

2024-12-24 17:59:51 +08:00

cpu_pooling_model_runner.py

[Misc] Rename embedding classes to pooling (#10801)

2024-12-01 14:36:51 +08:00

cpu_worker.py

mypy type checking for vllm/worker (#11418)

2024-12-23 13:55:49 +00:00

enc_dec_model_runner.py

[Model] Whisper model implementation (#11280)

2025-01-03 16:39:19 +08:00

hpu_model_runner.py

[Hardware][Intel-Gaudi] Enable LoRA support for Intel Gaudi (HPU) (#10565)

2024-12-12 08:09:28 +00:00

hpu_worker.py

[Doc] Update docs to refer to pooling models (#11093)

2024-12-11 13:36:27 +00:00

model_runner_base.py

[platforms] enable platform plugins (#11602)

2024-12-30 20:24:45 +08:00

model_runner.py

[Core][Bugfix] Use correct device to initialize GPU data during CUDA-graph-capture (#11233)

2025-01-04 14:50:16 +08:00

multi_step_model_runner.py

[perf]fix current stream (#11870)

2025-01-09 07:18:21 +00:00

multi_step_tpu_worker.py

[TPU] Implement multi-step scheduling (#8489)

2024-09-14 16:58:31 -07:00

multi_step_worker.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

neuron_model_runner.py

[1/N] Initial prototype for multi-modal processor (#10044)

2024-11-13 12:39:03 +00:00

neuron_worker.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

openvino_model_runner.py

[1/N] Initial prototype for multi-modal processor (#10044)

2024-11-13 12:39:03 +00:00

openvino_worker.py

Fix openvino on GPU (#10793)

2024-12-02 18:52:19 +00:00

pooling_model_runner.py

[Model] Add JambaForSequenceClassification model (#10860)

2024-12-19 22:48:06 +08:00

tpu_model_runner.py

Update requirements-tpu.txt to support python 3.9 and 3.11 (#11695)

2025-01-03 22:36:46 +00:00

tpu_worker.py

[TPU] Implement prefix caching for TPUs (#10307)

2024-11-20 13:54:15 -08:00

utils.py

[Doc][2/N] Reorganize Models and Usage sections (#11755)

2025-01-06 21:40:31 +08:00

worker_base.py

[platforms] enable platform plugins (#11602)

2024-12-30 20:24:45 +08:00

worker.py

[core] overhaul memory profiling and fix backward compatibility (#10511)

2024-12-16 13:32:25 -08:00

xpu_model_runner.py

[core] clean up cudagraph batchsize padding logic (#10996)

2024-12-13 06:57:50 +00:00

xpu_worker.py

[XPU] Make pp group initilized for pipeline-parallelism (#11648)

2025-01-07 11:09:58 +08:00