File tree 1 file changed +16
-0
lines changed
1 file changed +16
-0
lines changed Original file line number Diff line number Diff line change @@ -32,3 +32,19 @@ torch._C._LinAlgError: linalg.cholesky: The factorization could not be completed
32
32
[ AutoGPTQ/AutoGPTQ #196 ] ( https://github.com/AutoGPTQ/AutoGPTQ/issues/196 ) .
33
33
Try increasing ` percdamp ` (percent of the average Hessian diagonal to use for dampening),
34
34
or increasing ` nsamples ` (the number of calibration samples).
35
+ #### Issue 7:
36
+ If you run GPTQ quantization with transformers-like API on xpu device, then you may encounter the following error:
37
+ ``` shell
38
+ [ERROR][modeling_auto.py:128] index 133 is out of bounds for dimension 0 with size 128
39
+ [ERROR][modeling_auto.py:129] Saved low bit model loading failed, please check your model.
40
+ HINT:
41
+ XPU device does not support ` g_idx` for GPTQ quantization now. Please stay tuned.
42
+ You can set desc_act=False.
43
+ ```
44
+ #### Issue 8:
45
+ UnicodeEncodeError: 'charmap' codec can't encode character '\u2191' in position 195: character maps to <undefined >
46
+ ** Solution:**
47
+ ```
48
+ set PYTHONIOENCODING=UTF-8 # for windows
49
+ export PYTHONIOENCODING=UTF-8 # for linux
50
+ ```
You can’t perform that action at this time.
0 commit comments