You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
set paged attn block size as a env parameter (#1109)
* set default block size
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* decoding use single query
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* set block size as a env parameter
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
* set different default value for block size based on device
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
---------
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
0 commit comments