Skip to content

Commit 3263894

Browse files
committed
add comment for gemma
1 parent d599d41 commit 3263894

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

optimum/exporters/openvino/model_patcher.py

+1
Original file line numberDiff line numberDiff line change
@@ -273,6 +273,7 @@ def __enter__(self):
273273
super().__enter__()
274274

275275
# init inv_freq for torchscript tracing
276+
# https://github.com/huggingface/transformers/blob/ed74d97871468f3a4695ede50abdc0b55717a84d/src/transformers/models/gemma/modeling_gemma.py#L108
276277
for layer in self._model.model.layers:
277278
if layer.self_attn.rotary_emb.inv_freq is None:
278279
rotary_emb = layer.self_attn.rotary_emb

0 commit comments

Comments
 (0)