Cyrus Leung aa39a8e175 [Doc] Create a new "Usage" section (#10827) ...

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

2024-12-05 11:19:35 +08:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

cache_engine.py

[Kernel] Support sliding window in flash attention backend (#9403)

2024-10-20 10:57:52 -07:00

cpu_enc_dec_model_runner.py

[Bugfix] multi_modal_kwargs broadcast for CPU tensor parallel (#10541)

2024-11-22 21:25:46 -08:00

cpu_model_runner.py

Remove hard-dependencies of Speculative decode to CUDA workers (#10587)

2024-11-26 17:57:11 -08:00

cpu_pooling_model_runner.py

[Misc] Rename embedding classes to pooling (#10801)

2024-12-01 14:36:51 +08:00

cpu_worker.py

[Misc] Rename embedding classes to pooling (#10801)

2024-12-01 14:36:51 +08:00

enc_dec_model_runner.py

[torch.compile] remove compilation_context and simplify code (#10838)

2024-12-03 06:19:02 +00:00

hpu_model_runner.py

[Hardware] [HPU]add mark_step for hpu (#10239)

2024-11-17 00:44:44 -08:00

hpu_worker.py

[Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143)

2024-11-06 01:09:10 -08:00

model_runner_base.py

Remove hard-dependencies of Speculative decode to CUDA workers (#10587)

2024-11-26 17:57:11 -08:00

model_runner.py

[torch.compile] remove compilation_context and simplify code (#10838)

2024-12-03 06:19:02 +00:00

multi_step_model_runner.py

[Doc] Create a new "Usage" section (#10827)

2024-12-05 11:19:35 +08:00

multi_step_tpu_worker.py

[TPU] Implement multi-step scheduling (#8489)

2024-09-14 16:58:31 -07:00

multi_step_worker.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

neuron_model_runner.py

[1/N] Initial prototype for multi-modal processor (#10044)

2024-11-13 12:39:03 +00:00

neuron_worker.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

openvino_model_runner.py

[1/N] Initial prototype for multi-modal processor (#10044)

2024-11-13 12:39:03 +00:00

openvino_worker.py

Fix openvino on GPU (#10793)

2024-12-02 18:52:19 +00:00

pooling_model_runner.py

[Misc] Rename embedding classes to pooling (#10801)

2024-12-01 14:36:51 +08:00

tpu_model_runner.py

[TPU] Implement prefix caching for TPUs (#10307)

2024-11-20 13:54:15 -08:00

tpu_worker.py

[TPU] Implement prefix caching for TPUs (#10307)

2024-11-20 13:54:15 -08:00

utils.py

[Doc] Create a new "Usage" section (#10827)

2024-12-05 11:19:35 +08:00

worker_base.py

[Core] Implement disagg prefill by StatelessProcessGroup (#10502)

2024-12-01 19:01:00 -06:00

worker.py

[Core] Implement disagg prefill by StatelessProcessGroup (#10502)

2024-12-01 19:01:00 -06:00

xpu_model_runner.py

[1/N] Initial prototype for multi-modal processor (#10044)

2024-11-13 12:39:03 +00:00

xpu_worker.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00