Code

Enable quant model support#1074

Code

Merged

IlyasMoutawwakil merged 65 commits intohuggingface:mainhuggingface/optimum-intel:mainfrom jiqing-feng:quantjiqing-feng/optimum-intel:quantCopy head branch name to clipboardFeb 19, 2025

Commits

Commits on Dec 9, 2024

• enable IPEXModelForSeq2SeqLM

  Show description for 3888824
  jiqing-feng

  committed
  3888824

  Copy full SHA for 3888824

• set static cache

  Show description for f9fa807
  jiqing-feng

  committed
  f9fa807

  Copy full SHA for f9fa807

• add tests for IPEXModelForSeq2SeqLM

  Show description for 202df43
  jiqing-feng

  committed
  202df43

  Copy full SHA for 202df43

• add docs

  Show description for 4488073
  jiqing-feng

  committed
  4488073

  Copy full SHA for 4488073

• fix readme

  Show description for 16fecf8
  jiqing-feng

  committed
  16fecf8

  Copy full SHA for 16fecf8

Commits on Dec 10, 2024

• Merge branch 'main' into text2text

  jiqing-feng

  authored
  de501f4

  Copy full SHA for de501f4

Commits on Dec 11, 2024

• refactor compile

  Show description for 4225bf0
  jiqing-feng

  committed
  4225bf0

  Copy full SHA for 4225bf0

• fix check

  Show description for 2ac7ecf
  jiqing-feng

  committed
  2ac7ecf

  Copy full SHA for 2ac7ecf

• fix ruff check

  Show description for 24b988c
  jiqing-feng

  committed
  24b988c

  Copy full SHA for 24b988c

Commits on Dec 16, 2024

• Merge branch 'huggingface:main' into text2text

  jiqing-feng

  authored
  5c4f9a1

  Copy full SHA for 5c4f9a1

• enable quantized model

  Show description for 46b93a4
  jiqing-feng

  committed
  46b93a4

  Copy full SHA for 46b93a4

• add bnb test

  Show description for 82d39ce
  jiqing-feng

  committed
  82d39ce

  Copy full SHA for 82d39ce

• add bnb tests in yaml

  Show description for 7dc08da
  jiqing-feng

  committed
  7dc08da

  Copy full SHA for 7dc08da

• fix tests

  Show description for 30027ff
  jiqing-feng

  committed
  30027ff

  Copy full SHA for 30027ff

• disable bnb tests

  Show description for 314db04
  jiqing-feng

  committed
  314db04

  Copy full SHA for 314db04

• fix gpt2

  Show description for 87656ca
  jiqing-feng

  committed
  87656ca

  Copy full SHA for 87656ca

Commits on Dec 18, 2024

• Merge branch 'main' into quant

  jiqing-feng

  authored
  9a7e931

  Copy full SHA for 9a7e931

• set actual device

  Show description for b0cec9c
  jiqing-feng

  committed
  b0cec9c

  Copy full SHA for b0cec9c

• assign device when convert class

  Show description for 94cf35d
  jiqing-feng

  committed
  94cf35d

  Copy full SHA for 94cf35d

• fix class init

  Show description for 9af46d1
  jiqing-feng

  committed
  9af46d1

  Copy full SHA for 9af46d1

• fix ipex attn init

  Show description for 18b2a6a
  jiqing-feng

  committed
  18b2a6a

  Copy full SHA for 18b2a6a

• rm set device on config

  Show description for 9f6db33
  jiqing-feng

  committed
  9f6db33

  Copy full SHA for 9f6db33

• fix format

  Show description for 6d8a969
  jiqing-feng

  committed
  6d8a969

  Copy full SHA for 6d8a969

• fix mlp class init

  Show description for dd811f9
  jiqing-feng

  committed
  dd811f9

  Copy full SHA for dd811f9

Commits on Jan 14, 2025

• Merge branch 'huggingface:main' into quant

  jiqing-feng

  authored
  d91eefb

  Copy full SHA for d91eefb

Commits on Jan 21, 2025

• Merge branch 'main' into quant

  jiqing-feng

  authored
  f094cad

  Copy full SHA for f094cad

• add use_cache param when init generation config

  Show description for dab4a78
  jiqing-feng

  committed
  dab4a78

  Copy full SHA for dab4a78

• fix gpt2 quant model

  Show description for 6bf3b8b
  jiqing-feng

  committed
  6bf3b8b

  Copy full SHA for 6bf3b8b

Commits on Jan 22, 2025

• fix falcon linear fusion

  Show description for 356d51d
  jiqing-feng

  committed
  356d51d

  Copy full SHA for 356d51d

• fix falcon

  Show description for d1eee87
  jiqing-feng

  committed
  d1eee87

  Copy full SHA for d1eee87

Commits on Feb 7, 2025

• Merge branch 'huggingface:main' into quant

  jiqing-feng

  authored
  3aece6a

  Copy full SHA for 3aece6a

• enable awq model test

  Show description for 57e3c27
  jiqing-feng

  committed
  57e3c27

  Copy full SHA for 57e3c27

• fix install

  Show description for 8f6ba5c
  jiqing-feng

  committed
  8f6ba5c

  Copy full SHA for 8f6ba5c

• fix install

  Show description for 8870714
  jiqing-feng

  committed
  8870714

  Copy full SHA for 8870714

• fix install

  Show description for 5828fc0
  jiqing-feng

  committed
  5828fc0

  Copy full SHA for 5828fc0

• fix install

  Show description for c616d57
  jiqing-feng

  committed
  c616d57

  Copy full SHA for c616d57

• fix install

  Show description for e1715b8
  jiqing-feng

  committed
  e1715b8

  Copy full SHA for e1715b8

• fix install

  Show description for e88faf2
  jiqing-feng

  committed
  e88faf2

  Copy full SHA for e88faf2

• fix install

  Show description for 882f2b2
  jiqing-feng

  committed
  882f2b2

  Copy full SHA for 882f2b2

• fix install

  Show description for d8208c7
  jiqing-feng

  committed
  d8208c7

  Copy full SHA for d8208c7

• fix install

  Show description for 80b9ccb
  jiqing-feng

  committed
  80b9ccb

  Copy full SHA for 80b9ccb

• fix install

  Show description for f05fb2f
  jiqing-feng

  committed
  f05fb2f

  Copy full SHA for f05fb2f

• fix install

  Show description for bd8e870
  jiqing-feng

  committed
  bd8e870

  Copy full SHA for bd8e870

• fix install

  Show description for e471be3
  jiqing-feng

  committed
  e471be3

  Copy full SHA for e471be3

• fix install

  Show description for 96f4622
  jiqing-feng

  committed
  96f4622

  Copy full SHA for 96f4622

• fix install

  Show description for 32bf0a1
  jiqing-feng

  committed
  32bf0a1

  Copy full SHA for 32bf0a1

• fix install

  Show description for ad3467b
  jiqing-feng

  committed
  ad3467b

  Copy full SHA for ad3467b

• fix install

  Show description for 4a21d26
  jiqing-feng

  committed
  4a21d26

  Copy full SHA for 4a21d26

• fix install

  Show description for fb8002c
  jiqing-feng

  committed
  fb8002c

  Copy full SHA for fb8002c

• fix install

  Show description for 2ad2371
  jiqing-feng

  committed
  2ad2371

  Copy full SHA for 2ad2371

• enable bnb test

  Show description for 3c2ddef
  jiqing-feng

  committed
  3c2ddef

  Copy full SHA for 3c2ddef

• remove useless device

  Show description for 757ea8c
  jiqing-feng

  committed
  757ea8c

  Copy full SHA for 757ea8c

Commits on Feb 11, 2025

• update python to 3.10 on test_ipex

  Show description for 0a6ab0f
  jiqing-feng

  committed
  0a6ab0f

  Copy full SHA for 0a6ab0f

• Apply suggestions from code review

  IlyasMoutawwakil

  authored
  8c4884b

  Copy full SHA for 8c4884b

• install autoawq

  Show description for 7fa23a5
  jiqing-feng

  committed
  7fa23a5

  Copy full SHA for 7fa23a5

• install wheel

  Show description for 5386bbe
  jiqing-feng

  committed
  5386bbe

  Copy full SHA for 5386bbe

• fix install autoawq

  Show description for c5f5d16
  jiqing-feng

  committed
  c5f5d16

  Copy full SHA for c5f5d16

• rm autoawq

  Show description for 41513f0
  jiqing-feng

  committed
  41513f0

  Copy full SHA for 41513f0

Commits on Feb 12, 2025

• rebase

  Show description for 8e1caa2
  jiqing-feng

  committed
  8e1caa2

  Copy full SHA for 8e1caa2

• fix concat qkv

  Show description for f73c08d
  jiqing-feng

  committed
  f73c08d

  Copy full SHA for f73c08d

• fix format

  Show description for f51777b
  jiqing-feng

  committed
  f51777b

  Copy full SHA for f51777b

• fix qwen patch

  Show description for f64b251
  jiqing-feng

  committed
  f64b251

  Copy full SHA for f64b251

• fix bias

  Show description for 778bf15
  jiqing-feng

  committed
  778bf15

  Copy full SHA for 778bf15

• rm autoawq test

  Show description for 6ba1895
  jiqing-feng

  committed
  6ba1895

  Copy full SHA for 6ba1895

• fix style

  Show description for 88dba29
  jiqing-feng

  committed
  88dba29

  Copy full SHA for 88dba29