Skip to content

Commit 398870f

Browse files
Update README.md
Co-authored-by: Ella Charlaix <80481427+echarlaix@users.noreply.github.com>
1 parent 1a59c1b commit 398870f

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -204,7 +204,7 @@ You can find more examples in the [documentation](https://huggingface.co/docs/op
204204

205205

206206
## IPEX
207-
With `export=True`, IPEX model will replace torch linear to ipex linear which prepacks the weights. It will also apply linear fusioin and [IAKV](https://intel.github.io/intel-extension-for-pytorch/cpu/latest/tutorials/llm.html#indirect-access-kv-cache) for generation. Finally, jit.trace will be applied to change the model to graph mode.
207+
With `export=True`, IPEX model will replace torch linear to ipex linear which prepacks the weights. It will also apply linear fusion and [IAKV](https://intel.github.io/intel-extension-for-pytorch/cpu/latest/tutorials/llm.html#indirect-access-kv-cache) for generation. Finally, jit.trace will be applied to change the model to graph mode.
208208
Here is the example of how to use IPEX optimized model to generate texts.
209209
### generate
210210
```diff

0 commit comments

Comments
 (0)