You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Remove position_ids generation in IPEXModel forward (#566)
* fix jit model
* rm autocast in model
* support assisted decoding and add reorder cache function
* add comment for _prepare_past_key_values
* rebase main
* fix model_dtype
* rm useless comments
* fix class name
* revert _call_model
* fix model_dtype warning liog
* testiong low precision ipex model
* add assisted decoding
* remove low-precision testing as CI node does not support bf16
* fix conflict
* remove prepare position_ids in forward
* fix code style
0 commit comments