Skip to content

Commit 6045b56

Browse files
Kaihui-intelpre-commit-ci[bot]XuehaoSun
authored
Add v3.3 release faq (#2139)
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Sun, Xuehao <xuehao.sun@intel.com>
1 parent 4b0bb3b commit 6045b56

File tree

1 file changed

+16
-0
lines changed

1 file changed

+16
-0
lines changed

docs/source/faq.md

+16
Original file line numberDiff line numberDiff line change
@@ -32,3 +32,19 @@ torch._C._LinAlgError: linalg.cholesky: The factorization could not be completed
3232
[AutoGPTQ/AutoGPTQ#196](https://github.com/AutoGPTQ/AutoGPTQ/issues/196).
3333
Try increasing `percdamp` (percent of the average Hessian diagonal to use for dampening),
3434
or increasing `nsamples` (the number of calibration samples).
35+
#### Issue 7:
36+
If you run GPTQ quantization with transformers-like API on xpu device, then you may encounter the following error:
37+
```shell
38+
[ERROR][modeling_auto.py:128] index 133 is out of bounds for dimension 0 with size 128
39+
[ERROR][modeling_auto.py:129] Saved low bit model loading failed, please check your model.
40+
HINT:
41+
XPU device does not support `g_idx` for GPTQ quantization now. Please stay tuned.
42+
You can set desc_act=False.
43+
```
44+
#### Issue 8:
45+
UnicodeEncodeError: 'charmap' codec can't encode character '\u2191' in position 195: character maps to <undefined>
46+
**Solution:**
47+
```
48+
set PYTHONIOENCODING=UTF-8 # for windows
49+
export PYTHONIOENCODING=UTF-8 # for linux
50+
```

0 commit comments

Comments
 (0)