Code

Support AWQ models#1049

Code

Merged

AlexKoff88 merged 34 commits intohuggingface:mainhuggingface/optimum-intel:mainfrom mvafin:mvafin/support_awqmvafin/optimum-intel:mvafin/support_awqCopy head branch name to clipboardDec 23, 2024

Commits

Commits on Dec 4, 2024

• Support AWQ models

  mvafin

  committed
  64f64b0

  Copy full SHA for 64f64b0

Commits on Dec 5, 2024

• Add tests

  mvafin

  committed
  86d9328

  Copy full SHA for 86d9328

• Add dependencies

  mvafin

  committed
  decbcc2

  Copy full SHA for decbcc2

Commits on Dec 11, 2024

• Fix tests

  mvafin

  committed
  9fb1da4

  Copy full SHA for 9fb1da4

Commits on Dec 17, 2024

• enable awq export only if ov support it

  eaidova

  committed
  04d0cf9

  Copy full SHA for 04d0cf9

• Merge pull request #1 from eaidova/ea/awq_fix

  Show description for b51cdee
  eaidova

  authored
  b51cdee

  Copy full SHA for b51cdee

• fix style (#2)

  eaidova

  authored
  df97004

  Copy full SHA for df97004

• disable awq and gptq install for old torch (#3)

  Show description for cf2fc8b
  eaidova

  authored
  cf2fc8b

  Copy full SHA for cf2fc8b

• Merge branch 'main' into mvafin/support_awq

  eaidova

  authored
  ae8c7db

  Copy full SHA for ae8c7db

Commits on Dec 18, 2024

• separate common quant models patching and gptq (#4)

  eaidova

  authored
  f0f7a72

  Copy full SHA for f0f7a72

• disable windows install (#5)

  Show description for ab6ac99
  eaidova

  authored
  ab6ac99

  Copy full SHA for ab6ac99

Commits on Dec 19, 2024

• skip logits check for quantized models (#6)

  eaidova

  authored
  ff66f43

  Copy full SHA for ff66f43

• Merge branch 'main' into mvafin/support_awq

  eaidova

  authored
  3b73f17

  Copy full SHA for 3b73f17

• fix test after rebase

  eaidova

  committed
  e8be988

  Copy full SHA for e8be988

• fix testing condition for 2024.6 and unpatch in case if failed

  eaidova

  committed
  5d8bcb7

  Copy full SHA for 5d8bcb7

• Fix qwen2-vl tests (huggingface#1084)

  nikita-savelyevv

  authored
  cf3aad4

  Copy full SHA for cf3aad4

• Skip private mdoel loading test for external contributors (huggingface#1082)

  echarlaix

  authored
  106a5b7

  Copy full SHA for 106a5b7

• Fix reshaping unet if timestep is 0d tensor (huggingface#1083)

  eaidova

  authored
  cda4908

  Copy full SHA for cda4908

• Disable kv cache compression for fp vlm (huggingface#1080)

  eaidova

  authored
  8ef3997

  Copy full SHA for 8ef3997

Commits on Dec 20, 2024

• Support AWQ models

  

  mvafin

  authored and

  eaidova

  committed
  8e5573f

  Copy full SHA for 8e5573f

• Add tests

  

  mvafin

  authored and

  eaidova

  committed
  0d7f4bf

  Copy full SHA for 0d7f4bf

• Add dependencies

  

  mvafin

  authored and

  eaidova

  committed
  ae544af

  Copy full SHA for ae544af

• Fix tests

  

  mvafin

  authored and

  eaidova

  committed
  013081c

  Copy full SHA for 013081c

• enable awq export only if ov support it

  eaidova

  committed
  b7cd49d

  Copy full SHA for b7cd49d

• fix style (#2)

  eaidova

  committed
  da3bd88

  Copy full SHA for da3bd88

• disable awq and gptq install for old torch (#3)

  Show description for 0a0c7aa
  eaidova

  committed
  0a0c7aa

  Copy full SHA for 0a0c7aa

• separate common quant models patching and gptq (#4)

  eaidova

  committed
  55dad0c

  Copy full SHA for 55dad0c

• disable windows install (#5)

  Show description for c05aaf0
  eaidova

  committed
  c05aaf0

  Copy full SHA for c05aaf0

• skip logits check for quantized models (#6)

  eaidova

  committed
  40cd57f

  Copy full SHA for 40cd57f

• fix test after rebase

  eaidova

  committed
  9ddc5a8

  Copy full SHA for 9ddc5a8

• fix testing condition for 2024.6 and unpatch in case if failed

  eaidova

  committed
  a241a7d

  Copy full SHA for a241a7d

• add necessary packages in test_openvino_full

  eaidova

  committed
  b0e4860

  Copy full SHA for b0e4860

• Merge branch 'mvafin/support_awq' of https://github.com/mvafin/optimum-intel into mvafin/support_awq

  eaidova

  committed
  630d36a

  Copy full SHA for 630d36a

• fix code style after rebase (#7)

  eaidova

  authored
  7607f45

  Copy full SHA for 7607f45