Skip to content

Commit 6772655

Browse files
authored
Update README.md
1 parent 863f5ce commit 6772655

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

README.md

-1
Original file line numberDiff line numberDiff line change
@@ -206,7 +206,6 @@ You can find more examples in the [documentation](https://huggingface.co/docs/op
206206
## IPEX
207207
With `export=True`, IPEX model will replace torch linear to ipex linear which prepacks the weights. It will also apply linear fusion and [IAKV](https://intel.github.io/intel-extension-for-pytorch/cpu/latest/tutorials/llm.html#indirect-access-kv-cache) for generation. Finally, jit.trace will be applied to change the model to graph mode.
208208
Here is the example of how to use IPEX optimized model to generate texts.
209-
### generate
210209
```diff
211210
from transformers import AutoTokenizer, pipeline
212211
- from transformers import AutoModelForCausalLM

0 commit comments

Comments
 (0)