Lucia FangandLiuXiaoxuanPKU f525c0be8b [Model][Speculative Decoding] DeepSeek MTP spec decode (#12755) ...

Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>

2025-02-19 17:06:23 +08:00

..

__init__.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

adapters.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

arctic.py

[Quant] Arctic SupportsQuant (#13366)

2025-02-17 21:35:09 -08:00

aria.py

[Quant] Aria SupportsQuant (#13416)

2025-02-17 21:51:09 -08:00

baichuan.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

bamba.py

[Model] Support Mamba2 (Codestral Mamba) (#9292)

2025-02-17 20:17:50 +08:00

bart.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

bert.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

blip2.py

[VLM] Merged multi-modal processor for InternVL-based models (#12553)

2025-02-04 16:44:52 +08:00

blip.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

bloom.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

chameleon.py

[VLM] Merged multi-modal processor for InternVL-based models (#12553)

2025-02-04 16:44:52 +08:00

chatglm.py

[VLM] Separate text-only and vision variants of the same model architecture (#13157)

2025-02-13 06:19:15 -08:00

clip.py

[Bugfix] Fix Positive Feature Layers in Llava Models (#13514)

2025-02-19 08:50:07 +00:00

commandr.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

dbrx.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

decilm.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

deepseek_mtp.py

[Model][Speculative Decoding] DeepSeek MTP spec decode (#12755)

2025-02-19 17:06:23 +08:00

deepseek_v2.py

[Model][Speculative Decoding] DeepSeek MTP spec decode (#12755)

2025-02-19 17:06:23 +08:00

deepseek_vl2.py

[VLM] Merged multi-modal processor for InternVL-based models (#12553)

2025-02-04 16:44:52 +08:00

deepseek.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

eagle.py

[Feature][Spec Decode] Simplify the use of Eagle Spec Decode (#12304)

2025-02-16 19:32:26 -08:00

exaone.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

fairseq2_llama.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

falcon.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

florence2.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

fuyu.py

[Doc] [2/N] Add Fuyu E2E example for multimodal processor (#13331)

2025-02-15 07:06:23 -08:00

gemma2.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

gemma.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

glm4v.py

[VLM] Keep track of whether prompt replacements have been applied (#13215)

2025-02-14 04:20:46 -08:00

glm.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

gpt2.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

gpt_bigcode.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

gpt_j.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

gpt_neox.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

granite.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

granitemoe.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

gritlm.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

h2ovl.py

[VLM] Merged multi-modal processor for InternVL-based models (#12553)

2025-02-04 16:44:52 +08:00

idefics2_vision_model.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

idefics3.py

[VLM] merged multimodal processor and V1 support for idefics3 (#12660)

2025-02-04 20:00:51 +08:00

interfaces_base.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

interfaces.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

intern_vit.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

internlm2_ve.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

internlm2.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

internvl.py

[VLM] Use shared field to pass token ids to model

2025-02-05 13:30:46 -08:00

jais.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

jamba.py

[Model] Support Mamba2 (Codestral Mamba) (#9292)

2025-02-17 20:17:50 +08:00

llama.py

[RFC] [Mistral] FP8 format (#10130)

2025-02-08 14:12:53 -07:00

llava_next_video.py

[VLM] Merged multi-modal processor for InternVL-based models (#12553)

2025-02-04 16:44:52 +08:00

llava_next.py

[VLM] Update compatibility with transformers 4.49

2025-02-05 19:09:45 -08:00

llava_onevision.py

[VLM] Keep track of whether prompt replacements have been applied (#13215)

2025-02-14 04:20:46 -08:00

llava.py

[Bugfix] Fix Positive Feature Layers in Llava Models (#13514)

2025-02-19 08:50:07 +00:00

mamba2.py

[Model] Support Mamba2 (Codestral Mamba) (#9292)

2025-02-17 20:17:50 +08:00

mamba_cache.py

[Model] Support Mamba2 (Codestral Mamba) (#9292)

2025-02-17 20:17:50 +08:00

mamba.py

[Model] Support Mamba2 (Codestral Mamba) (#9292)

2025-02-17 20:17:50 +08:00

medusa.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

minicpm3.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

minicpm.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

minicpmo.py

[VLM] Check required fields before initializing field config in DictEmbeddingItems (#13380)

2025-02-17 01:36:07 -08:00

minicpmv.py

[VLM] Check required fields before initializing field config in DictEmbeddingItems (#13380)

2025-02-17 01:36:07 -08:00

mixtral_quant.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

mixtral.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

mllama.py

[VLM] Implement merged multimodal processor for Mllama (#11427)

2025-02-12 20:26:21 -08:00

mlp_speculator.py

[Doc] Replace ibm-fms with ibm-ai-platform (#12709)

2025-02-04 07:05:04 +00:00

module_mapping.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

molmo.py

[Quant] Molmo SupportsQuant (#13336)

2025-02-17 21:34:47 -08:00

mpt.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

nemotron.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

nvlm_d.py

[VLM] Merged multi-modal processor for InternVL-based models (#12553)

2025-02-04 16:44:52 +08:00

olmo2.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

olmo.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

olmoe.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

opt.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

orion.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

paligemma.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

persimmon.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

phi3_small.py

[Bugfix] Fix loading of fine-tuned models based on Phi-3-Small (#12689)

2025-02-04 20:58:48 +08:00

phi3.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

phi3v.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

phi.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

phimoe.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

pixtral.py

[Bugfix] Fix Positive Feature Layers in Llava Models (#13514)

2025-02-19 08:50:07 +00:00

prithvi_geospatial_mae.py

[Model] IBM/NASA Prithvi Geospatial model (#12830)

2025-02-11 20:34:30 -08:00

qwen2_5_vl.py

[Bugfix] Fix qwen2.5-vl image processor (#13286)

2025-02-15 03:00:11 -08:00

qwen2_audio.py

[VLM] Keep track of whether prompt replacements have been applied (#13215)

2025-02-14 04:20:46 -08:00

qwen2_moe.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

qwen2_rm.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

qwen2_vl.py

[VLM] Check required fields before initializing field config in DictEmbeddingItems (#13380)

2025-02-17 01:36:07 -08:00

qwen2.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

qwen_vl.py

[VLM] Keep track of whether prompt replacements have been applied (#13215)

2025-02-14 04:20:46 -08:00

qwen.py

[VLM] Separate text-only and vision variants of the same model architecture (#13157)

2025-02-13 06:19:15 -08:00

registry.py

[Model][Speculative Decoding] DeepSeek MTP spec decode (#12755)

2025-02-19 17:06:23 +08:00

roberta.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

siglip.py

[Bugfix] Fix Positive Feature Layers in Llava Models (#13514)

2025-02-19 08:50:07 +00:00

solar.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

stablelm.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

starcoder2.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

telechat2.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

transformers.py

[Model] Enable quantization support for transformers backend (#12960)

2025-02-17 19:52:47 -08:00

ultravox.py

[Model] Ultravox Model: Support v0.5 Release (#12912)

2025-02-10 22:02:48 +00:00

utils.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

vision.py

[Bugfix] Fix Positive Feature Layers in Llava Models (#13514)

2025-02-19 08:50:07 +00:00

whisper.py

[Frontend] Add /v1/audio/transcriptions OpenAI API endpoint (#12909)

2025-02-13 07:23:45 -08:00