iHore/vLLM - vLLM - iHore Software Repository

23,341 Commits 3 Branches 0 Tags

2 Commits

Author	SHA1	Message	Date
Vibhav Agarwal Xinyu Chen Michael Goin	f4b42df048	[Attention Backend] TurboQuant: 2-bit KV cache compression with 4x capacity (#38479 ) Signed-off-by: vibhavagarwal5 <vibhavagarwal5@gmail.com> Signed-off-by: Michael Goin <mgoin64@gmail.com> Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com> Co-authored-by: Michael Goin <mgoin64@gmail.com>	2026-04-14 19:57:13 -07:00
Vibhav Agarwal vibhav-agarwal Claude Opus 4.6	d4cb783c10	[Bugfix] Fix GDN FLA kernel crashes with NULL_BLOCK_ID=0 CUDA graph padding (#39064 ) Signed-off-by: Vibhav Agarwal <vibhavagarwal5@gmail.com> Co-authored-by: vibhav-agarwal <vibhav.agarwal@glance.com> Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>	2026-04-11 08:35:19 +00:00

Author

SHA1

Message

Date

f4b42df048

[Attention Backend] TurboQuant: 2-bit KV cache compression with 4x capacity (#38479 )

Signed-off-by: vibhavagarwal5 <vibhavagarwal5@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

2026-04-14 19:57:13 -07:00

d4cb783c10

[Bugfix] Fix GDN FLA kernel crashes with NULL_BLOCK_ID=0 CUDA graph padding (#39064 )

Signed-off-by: Vibhav Agarwal <vibhavagarwal5@gmail.com>
Co-authored-by: vibhav-agarwal <vibhav.agarwal@glance.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

2026-04-11 08:35:19 +00:00