iHore/vLLM
8
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
23,341 Commits 3 Branches 0 Tags
patches
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Taneem Ibrahim a6b39f0262 [Bugfix] Clean up async client sockets after event loop closure (#57757) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-10-09 10:32:47 -04:00
Taneem IbrahimandLucas Wilkinson d64f6cd08a [CI] Auto-label pooling PRs and issues (#59913) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
 2026-10-04 13:26:10 +00:00
Taneem Ibrahim f0c44cc7d5 [Bugfix] Fix stalled local-only Elastic EP scale-up (#57820) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-10-02 10:47:55 -04:00
Taneem IbrahimandWentao Ye 6ec2f84e1a [Pooling] Preserve BERT-family heads for raw logits (#57664) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-09-25 19:10:14 -04:00
Taneem Ibrahim 2bc902eb0f [CI] [MRV2] Restore MRV2 pp dp coverage (#57735) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-25 19:13:59 +00:00
Taneem IbrahimandWentao Ye bb35e2587b [Pooling] Preserve reranker tokenization with document limits (#57666) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-09-25 11:04:41 -04:00
Taneem Ibrahimandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 50f78084da [Bugfix] Fix generative scoring body cancellation (#57729) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-25 11:01:31 -04:00
Taneem Ibrahim bbd7c24d6e [MRV2] Validate MRV2 entrypoint logits processors (#57728) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-24 09:07:26 +00:00
Taneem Ibrahim bc162b3f92 [MRV2] Release weight offloader on shutdown (#57834) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-22 15:01:20 -04:00
Taneem Ibrahim 7d06dd1ffa [Pooling] MRV2 pooling shutdown model ref (#57737) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-21 16:54:57 -07:00
Taneem Ibrahim 887cf91e30 [Pooling] Fix normalization of chunked long-text embeddings (#57498) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-21 10:46:39 -04:00
Taneem Ibrahim 2b8a5495a8 [Mypy] Fix mypy typing for N/O models (#54142) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-18 12:50:01 +01:00
Taneem IbrahimandHarry Mellor e960ead0aa [Mypy] Fix mypy typing for Transformers models (#54320) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-09-17 12:11:31 -04:00
Taneem Ibrahimandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 1fd119def5 [Pooling] Cap max-length padding for chunked embeddings (#56505) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-15 20:31:51 -04:00
Taneem Ibrahim 2fcc524788 [Bugfix] Avoid nested score cancellation handlers for /v1/score alias (#57024) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-15 15:41:54 -04:00
Taneem Ibrahim 64856080b0 [Bugfix] Measure complete pooling responses (#56760) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-15 09:21:05 -04:00
Taneem Ibrahimandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> ba2ae9f239 [MRV2] Run pooling post processing on non-final PP ranks (#56666) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-14 16:11:11 -07:00
Taneem Ibrahimandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 8e08cef46e [Bugfix] Redact credentials from benchmark logs (#56662) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-09-14 18:58:33 -04:00
Taneem Ibrahim 2e9f7bb454 [Pooling] Report actual input token usage for scoring APIs (#56573) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-13 09:20:21 -04:00
Taneem Ibrahim 0cf266a469 [Pooling] Support prompt embeddings in MRV2 decoder pooling (#56639) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-13 05:49:45 +00:00
Taneem Ibrahim 1b29c508bc [Bugfix] Initialize data parser in Nano-Nemotron audio test (#56401) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-12 09:07:20 -04:00
Taneem Ibrahim a0914ab7d0 [Nano-Nemotron] Fix Nano-Nemotron precomputed multimodal embeddings (#56398) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-12 09:07:10 -04:00
Taneem Ibrahim f9083cb83a [Mypy] Fix typing for R/S models (#54157) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-10 09:43:08 -04:00
Taneem Ibrahim 4ebf61ebda [Cohere] Bound remaining request priorities to the MessagePack int64 range (#56146) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-09 18:57:01 -04:00
Taneem Ibrahim af51d0ef03 [Pooling] Report LoRA adapter names in responses (#56004) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-09 13:31:13 -04:00
Taneem Ibrahim 5af4cc33ec [Bugfix] Fix OpenPangu multimodal embedding merge (#55941) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-08 23:53:59 +00:00
Taneem Ibrahim fdfa0a1659 [Pooling] Honor request_id from request bodies (#55665) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-07 19:55:20 -04:00
Taneem Ibrahim 252ed87621 [Bugfix] Restore Responses validation error boundary (#55761) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-07 22:12:18 +00:00
Taneem Ibrahim ecd600d91e [Pooling] Honor max_embed_len for chunked embeddings (#55551) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-07 09:31:40 -04:00
Taneem IbrahimandHarry Mellor 784cac7c42 [Mypy] Fix mypy typing for P models (#54169) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-09-04 20:47:11 +00:00
Taneem Ibrahim 3284af6bf1 [Bugfix] Reject 0 or non-positive max concurrency (#54887) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-04 15:59:29 -04:00
Taneem Ibrahim c615b1fd67 [Mypy] Fix mypy typing for L models (#54177) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-04 07:50:43 -04:00
Taneem Ibrahim e41011129b [CI] Avoid logging test server environment values (#54379) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-03 17:00:29 -04:00
Taneem Ibrahim 758c79e1c5 [Bugfix] Retain vocab embeddings during replacement (#55083) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-03 04:17:38 -07:00
Taneem Ibrahim 27a94d1ce4 [CI] Fix DeepSeek-V4 registry platform guard (#55042) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-03 03:27:01 +00:00
Taneem Ibrahim 76f3249fbd [Mypy] Fix typing for M models (#54262) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-01 11:26:00 -04:00
Taneem Ibrahim d9eb4e344f [Bugfix] Reject tokenless chat and audio streams (#54708) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-09-01 11:24:19 -04:00
Taneem Ibrahim fe6db3ed5e [Bugfix] Validate scale-out transfer params (#54324) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-30 09:46:12 -04:00
Taneem Ibrahim fd5d3aea94 [Mypy] Fix typing for J models (#54130) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-29 08:50:15 -04:00
Taneem IbrahimandWentao Ye 21fa2c5a2a [Mypy] Fix mypy typing for model interfaces and H/I models (#54079) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-08-28 16:49:19 -04:00
Taneem Ibrahim d7b6a35967 [Bugfix] Handle malformed namespace tools (#53763) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-27 14:18:16 -04:00
Taneem Ibrahim f18e29834b [Bugfix] Preserve parallel HY-V3 calls delivered in one streaming delta (#53965) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-27 11:26:10 -04:00
Taneem Ibrahim 9c8e90eb26 [Bugfix] Handle parenthesized Gemma4 tool calls (#53657) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-25 08:21:42 -04:00
Taneem Ibrahim 2014e47485 [Pooling UX] Improve serve --task error guidance (#53467) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-25 08:20:10 -04:00
Taneem Ibrahim 79bb395eea [Pooling] Improve BGE-M3 sync pooling throughput by up to 3.13% (#53464) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-24 08:33:32 -04:00
Taneem Ibrahim a014e35f38 [Pooling] Fix Rust pooling endpoint for benchmark (#53352) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-22 15:45:09 -04:00
Taneem Ibrahimandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 704f12aa1e [Pooling] Report input throughput for batched requests (#53213) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-08-22 09:01:40 -04:00
Taneem Ibrahim 5d4d470470 [CI] Fix nonexistent dependency for data-parallel example test selection (#53026) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-20 09:11:00 +00:00
Taneem Ibrahim 842dd8fd96 [Pooling] Use semantic task validation errors (#52867) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-19 07:21:08 +00:00
Taneem Ibrahim 08afae2786 [ModelRunner v2] Enable MRV2 for pooling models by default (#48290) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-18 21:36:05 -07:00
Taneem Ibrahim be3f614ff1 [CI] Register CPU CI "VLLM_CPU_CI_ENV" environment variable (#52633) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-18 08:28:00 -04:00
Taneem Ibrahim 6b0b850a8b [CI] Fit small KV-offload evals within shared memory (#52496) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-16 16:16:51 -04:00
Taneem Ibrahim fdab2b10bc [ModelRunner v2] Support Transformers pooling model (#52425) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-16 15:25:49 -04:00
Taneem IbrahimandWentao Ye 1f0e0bf612 [Bugfix][Attention] Temporarily disable FA4 head-dim 256 (#52050) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-08-16 17:13:02 +00:00
Taneem Ibrahim d0ae25e2f2 [Bugfix] Preserve Anthropic disable_parallel_tool_use (#52021) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-13 08:25:55 -04:00
Taneem Ibrahim 6ea6c42659 [Bugfix] Bound Anthropic stop sequences (#51997) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-12 12:05:12 -04:00
Taneem IbrahimandWentao Ye ca9c8cbd1b [CI] Support partial torch requirement contexts (#51832) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-08-11 12:25:14 -04:00
Taneem IbrahimandWentao Ye ea3115e30b [CI] Stabilize DP supervisor lifecycle tests (#51557) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-08-10 09:13:52 -04:00
Taneem Ibrahim 9464529612 [ModelRunner v2] Enable decoder token-wise pooling (#50931) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-06 22:21:52 +00:00
Taneem IbrahimandWentao Ye 1c0d207915 [Bugfix] Default Gemma3 Model intermediate_tensors to None (#50777) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-08-03 15:07:59 -04:00
Taneem Ibrahim 55c98e370a [Model Runner v2] Enable BGE M3 pooling embed token_classify (#50661) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-02 12:46:03 -04:00
Taneem Ibrahim 652ba59229 [Model Runner V2] Enable encoder token embedding (#50574) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-08-01 07:55:36 -04:00
Taneem IbrahimOpenAI CodexIsotr0py
 		f727951d3f [Bugfix] Re-land MiniMax M3 default video processor (#50305) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
 2026-07-31 07:46:18 +00:00
Taneem Ibrahim 0f17394564 [Model Runner V2] Enable encoder token classification (#50293) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-07-31 04:15:36 +00:00
Taneem Ibrahim 43eaefba5a [ModelRunner V2] Enable sequence pooling for embedding and classification models (#48791) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-07-29 06:30:45 -07:00
Taneem Ibrahim 0da6e7f3d6 [Bugfix] Reject contradictory custom-op directives (#49134) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-07-26 08:42:14 -04:00
Taneem Ibrahim 0164022c90 [CI] Fix speech correctness check rejecting improved WER (#49853) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-07-26 06:24:07 +00:00
Taneem Ibrahim dbd80cc031 [UX] DCP Topology Validation (#49777) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-07-25 16:53:57 -04:00
Taneem Ibrahim 6b0103d1c9 [CI] Stabilize Pooling Rerank Equivalence Test (#49822) 2026-07-25 14:36:50 -04:00
Taneem IbrahimandWentao Ye 453f01783d [UX] Improve data-parallel launch validation (#49124) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-07-24 07:16:39 -07:00
Taneem Ibrahimandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 7b40fb9645 [UX] Reject incompatible nested runtime overrides (#49247) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-24 07:16:22 -07:00
Taneem Ibrahim e6d1310b2a [Bugfix] Reject removed pooling parameters (#48984) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-07-19 05:18:03 -07:00
Taneem Ibrahimandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> de100ffb62 [Docs] Document pooling config resolution (#48497) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-15 14:24:16 -04:00
Taneem Ibrahimandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 9182e86971 Log fully resolved pooling config at startup (#48030) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-14 22:00:46 +00:00
Taneem Ibrahimandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 62286308c9 [Misc] Improve Matryoshka pooling dimensions validation (#48057) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-13 12:57:36 -04:00
Taneem IbrahimandWentao Ye 1d354c694e [Misc] Validate Pooling cache_salt Values (#46966) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-07-04 10:19:28 -04:00
Taneem Ibrahim 2f21224527 [Misc] Update request-extras parity for batch chat completion (#47333) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-07-04 10:19:04 -04:00
Taneem Ibrahimmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Wentao Ye
 		fa1fa968c4 [Misc] Forward request-level prompt extras for cross-encoder scoring (#46939) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-07-04 10:18:36 -04:00
Taneem Ibrahimandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 6eac8e0070 [Misc] Preserve cross-encoder pooling extra kwargs (#47082) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-04 08:14:13 -04:00
Taneem Ibrahim 8bf064f8d3 Fixed chunked embedding aggregation with request-id metadata (#46782) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-06-27 20:57:47 +00:00
Taneem Ibrahimandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> 6f3da461d1 [Pooling] Fix Cohere embed billed image token accounting for mixed-content inputs (#46093) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-25 10:44:29 -04:00
Taneem Ibrahim 40e5522121 [Docs] Add Qwen3 forced alignment online example (#46197) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-06-23 11:59:45 -04:00
Taneem Ibrahimandmergify[bot] <37929162+mergify[bot]@users.noreply.github.com> f2069b005b [Pooling] Validate non-negative rerank top_n (#46119) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-22 11:40:47 -04:00
Taneem Ibrahim 43fa24e832 [Misc] Validate Cohere Embed Mixed Content Payloads (#45873) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-06-17 06:57:12 +00:00
Taneem Ibrahim 81d8f4ebac [Misc] Added validation for Cohere /v2/embed input field exclusivity (#45640) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-06-16 05:42:43 +00:00
Taneem Ibrahim 2c764c089a Added real /v1/embeddings support for messages + chat_template_kw (#45173) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-06-15 09:08:10 +08:00
Taneem Ibrahim 5633405964 Added extra_repr() to pooler classes to improve debuggability (#44805) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-06-08 03:19:31 +00:00
Taneem Ibrahim eafbb06331 [Misc] Replaced asserts with proper exceptions to improve UX for pooling (#44593) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-06-06 05:57:26 +00:00
Taneem Ibrahim 8d9536a775 [Misc] Add unit tests for pooler head classes (#44471) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-06-04 17:59:25 +00:00
Taneem IbrahimandWentao Ye 5502c3b52d [Misc] added unit tests for the core pooling methods (#43818) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-05-29 14:40:31 +00:00
Taneem Ibrahim 3a1c062151 [Misc] Added missing return type annotations to improve mypy and IDE tooling (#43383) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-05-23 13:28:22 +08:00
Taneem IbrahimClaude Opus 4.6Nick Hill
 		b3c7ffcab8 [Misc] Replace assert with proper exceptions for security and validation in pooling (#43286) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-05-22 18:43:33 +08:00
Taneem Ibrahim 4a4fdabe28 [Misc] Aligning tokwise pooler heads for consistency (#43041) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-05-19 06:16:42 +00:00
Taneem Ibrahim 1c8e9c0399 Refactor: Pass num_labels explicitly to PoolerClassify instead of reading from global config (#42851) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-05-17 14:40:21 +00:00
Taneem Ibrahim 787bc0d031 Add unit tests for pooler activation functions (#42824) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-05-16 14:58:16 -04:00
Taneem Ibrahimgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Wentao Ye
 		503697c9ce [chore] Refactor pooling metadata token ID accessors (#42368) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-05-13 06:08:01 +00:00
Taneem Ibrahim 54dc64d5d3 [Doc] Add Qwen3-30B-A3B-Thinking-2507-FP8 to batch invariance verified models (#41513) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-05-03 08:47:55 -04:00
Taneem Ibrahim 8d6b3d5dda [Misc] Refactored 5 duplicate helper functions that were copied-pasted across multiple parsers (#36436) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-03-09 14:14:11 -04:00
Taneem Ibrahim 5261223c2d [Misc] Remove duplicate parser registration (#36303) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-03-07 09:37:01 -05:00
Taneem IbrahimandHarry Mellor 1aaec59d79 [MISC] fixed tool_parser mypy errors (#35640) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-04 12:23:12 +00:00