Merge pull request #27 from wgzintel/guozhong/fix_chatglm2-6b_cannot_set_attribute

Add solution of chatglm2-6b cannot set attribute to Readme

Author: peterchen-intel

llm_bench/python/README.md

@@ -110,3 +110,24 @@ Add the option `--torch_compile_backend` with the desired backend: `pytorch` or
 ```bash
 python ./benchmark.py -m models/llama-2-7b-chat/pytorch -d CPU --torch_compile_backend openvino
 ```
+# Notes
+## chatglm2-6b - AttributeError: can't set attribute
+Download chatglm2-6b from hugginface, convert to OpenVINO IR files and run with benchmark.py, the following error may occur：
+```bash
+AttributeError: can't set attribute
+```
+Reproduced with https://huggingface.co/THUDM/chatglm2-6b 7fabe56db91e085c9c027f56f1c654d137bdba40 <br />
+As on https://huggingface.co/THUDM/chatglm2-6b/discussions/99 <br />
+Solution: update `tokenization_chatglm.py` as following: <br />
+```Python
+          self.vocab_file = vocab_file
+          self.tokenizer = SPTokenizer(vocab_file)
+ +        kwargs.pop("eos_token", None)
+ +        kwargs.pop("pad_token", None)
+ +        kwargs.pop("unk_token", None)
+          self.special_tokens = {
+              "<bos>": self.tokenizer.bos_id,
+              "<eos>": self.tokenizer.eos_id,
+```              
+
+> The solution works for chatglm3-6b as well.