Skip to content

Commit 8010e60

Browse files
committed
import helpers from phi3 if available
1 parent 9917b6b commit 8010e60

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

optimum/exporters/openvino/model_patcher.py

+5-1
Original file line numberDiff line numberDiff line change
@@ -971,7 +971,11 @@ def _phi3_self_attn_sdpa_forward(
971971
use_cache=use_cache,
972972
)
973973

974-
from transformers.models.llama.modeling_llama import apply_rotary_pos_emb, repeat_kv
974+
# TO DO: remove llama imports when transformers with phi3 support will be released
975+
try:
976+
from transformers.models.phi3.modelling_phi3 import apply_rotary_pos_emb, repeat_kv
977+
except ImportError:
978+
from transformers.models.llama.modeling_llama import apply_rotary_pos_emb, repeat_kv
975979

976980
bsz, q_len, _ = hidden_states.size()
977981

0 commit comments

Comments
 (0)