5 Commits

Include renames

Author	SHA1	Message	Date
Robert Shaw	9ba415588a	[BugFix] Fix Embedding Models with TP>1 (#5075)	2024-05-28 08:32:42 -07:00
Nick Hill	eb6d3c264d	[Core] Eliminate parallel worker per-step task scheduling overhead (#4894)	2024-05-23 06:17:27 +09:00
SangBin Cho	65bf2ac165	[Core][2/N] Model runner refactoring part 2. Combine prepare prefill / decode to a single API (#4681) ... This PR combines prepare_prompt and prepare_decode into a single API. This PR also coelsce the attn metadata for prefill/decode to a single class and allow to slice them when running attn backend. It also refactors subquery_start_loc which was not refactored in the previous PR	2024-05-15 14:00:10 +09:00
Woosuk Kwon	0fca3cdcf2	[Misc] Enhance attention selector (#4751)	2024-05-13 10:47:25 -07:00
Chang Su	e254497b66	[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)	2024-05-11 11:30:37 -07:00