We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 8a49f9c commit 7570d71Copy full SHA for 7570d71
README.md
@@ -49,15 +49,13 @@ Here is the example of how to use IPEX optimized model to generate texts.
49
### generate
50
```diff
51
import torch
52
-from transformers import AutoTokenizer, AutoConfig
+from transformers import AutoTokenizer
53
- from transformers import AutoModelForCausalLM
54
+ from optimum.intel.ipex import IPEXModelForCausalLM
55
56
-config = AutoConfig.from_pretrained("gpt2")
57
- model = AutoModelForCausalLM.from_pretrained(
58
+ model = IPEXModelForCausalLM.from_pretrained(
59
"gpt2",
60
- config=config,
61
torch_dtype=torch.bfloat16,
62
export=True,
63
)
0 commit comments