This website requires JavaScript.
Explore
Help
Sign In
iHore
/
vLLM
Watch
8
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
Files
899541bdb1e42762c17a8cb5cf5bf2800ef63811
vLLM
/
examples
/
offline_inference
T
History
Ning Xie
d74132ca3b
fix offline inference chat response prompt (
#32088
)
...
Signed-off-by: Andy Xie <
andy.xning@gmail.com
>
2026-01-11 14:01:18 +00:00
..
basic
[Bugfix] fix offline chat output prompt (
#32076
)
2026-01-10 07:50:57 +00:00
disaggregated-prefill-v1
…
kv_load_failure_recovery
…
logits_processor
…
openai_batch
…
qwen2_5_omni
…
qwen3_omni
…
async_llm_streaming.py
…
audio_language.py
…
automatic_prefix_caching.py
…
batch_llm_inference.py
…
chat_with_tools.py
…
context_extension.py
fix offline inference chat response prompt (
#32088
)
2026-01-11 14:01:18 +00:00
data_parallel.py
…
disaggregated_prefill.py
…
encoder_decoder_multimodal.py
…
llm_engine_example.py
…
llm_engine_reset_kv.py
…
load_sharded_state.py
…
lora_with_quantization_inference.py
…
metrics.py
…
mistral-small.py
…
mlpspeculator.py
…
multilora_inference.py
…
prefix_caching.py
…
prompt_embed_inference.py
…
qwen_1m.py
…
reproducibility.py
…
rlhf_colocate.py
…
rlhf_online_quant.py
…
rlhf_utils.py
…
rlhf.py
…
save_sharded_state.py
…
simple_profiling.py
[Cleanup] Refactor profiling env vars into a CLI config (
#29912
)
2025-12-09 13:29:33 -05:00
skip_loading_weights_in_engine_init.py
…
spec_decode.py
fix offline inference chat response prompt (
#32088
)
2026-01-11 14:01:18 +00:00
structured_outputs.py
…
torchrun_dp_example.py
…
torchrun_example.py
…
vision_language_multi_image.py
…
vision_language.py
[Model] Add LFM2-VL model support (
#31758
)
2026-01-08 05:00:27 -08:00