Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor and Add Tests #2

Open
wants to merge 76 commits into
base: openvino_tokenizers
Choose a base branch
from
+2,754 −581
Open

Refactor and Add Tests #2

Changes from 1 commit
Commits
Show all changes
76 commits
Select commit Hold shift + click to select a range
8340e1d
Fix model dtype (#502)
jiqing-feng Jan 8, 2024
77f9756
Add ipex inference llama test (#503)
jiqing-feng Jan 8, 2024
03e1fa6
Disable marian test until openvino next release (#504)
echarlaix Jan 8, 2024
c64025d
Add INC modeling position_ids generation (#456)
jiqing-feng Jan 8, 2024
aa5b71b
Add f32 precision for compare-with-transformers tests (#508)
helena-intel Jan 10, 2024
ba2487b
Fix typo inside InferRequestWrapper
nikita-savelyevv Jan 11, 2024
23f4f5d
Merge pull request #511 from nikita-savelyevv/fix-infer-request-wrapp…
AlexKoff88 Jan 12, 2024
3f7551e
Add try for get_property (#510)
wgzintel Jan 12, 2024
545ad5a
Fix error with optimum-cli export openvino --help
helena-intel Jan 13, 2024
3c196c3
Merge pull request #514 from huggingface/helena/optimum-cli-fix
AlexKoff88 Jan 15, 2024
133aa7d
Bump min torch version (#515)
echarlaix Jan 15, 2024
7f236c2
Add OPenVINO stateful model support (#493)
eaidova Jan 16, 2024
2f2a764
Add openvino-nightly to automated tests (#506)
helena-intel Jan 16, 2024
e22a2ac
Fix loading Timm models with ov_config (#517)
helena-intel Jan 16, 2024
76ce9de
Use f32 inference for some OpenVINO stable diffusion/training tests (…
helena-intel Jan 17, 2024
94bc226
Convert tokenizers with openvino_tokenizers
slyalin Jan 5, 2024
6bb395f
Update optimum/exporters/openvino/__main__.py
slyalin Jan 5, 2024
7d16ec7
Refactor and Add Tests
apaniukov Jan 9, 2024
f0933ad
Fix t5 Test
apaniukov Jan 10, 2024
24cc616
Add Warning
apaniukov Jan 10, 2024
49337b0
Return Tests
apaniukov Jan 10, 2024
7709043
Move export_tokenizer to convert.py
apaniukov Jan 10, 2024
dbd609b
Avoid Double Tokenizer Save
apaniukov Jan 12, 2024
7e24f10
Fix Style
apaniukov Jan 12, 2024
2cf460d
Refactor After Review
apaniukov Jan 18, 2024
57782d1
Skip Tokenizers Tests If No Package Installed
apaniukov Jan 18, 2024
db668da
Merge branch 'main' into openvino_tokenizers
apaniukov Jan 18, 2024
e00c5fc
Return the original forward after exporting the PyTorch model to Open…
alexsu52 Jan 18, 2024
cbb5fde
Fix Inference docs (#525)
ngaloppo Jan 19, 2024
e7cd70f
Style Fix
apaniukov Jan 19, 2024
40cf117
Fix OV Tokenizers Check
apaniukov Jan 19, 2024
4652ae4
Add warning message when using transformers < 4.35 (#524)
helena-intel Jan 19, 2024
901f48a
Fix Tests
apaniukov Jan 19, 2024
ff1e382
Fix compatibility with transformers (#527)
echarlaix Jan 19, 2024
69140bf
Fix quantization tests for opeenvino-nightly (#523)
eaidova Jan 22, 2024
af2e986
split create pkv to a function (#521)
jiqing-feng Jan 22, 2024
ac640ed
Add test for _print_compiled_model_properties (#528)
helena-intel Jan 23, 2024
672c022
Enable automatic CACHE_DIR for GPU inference only (#520)
helena-intel Jan 23, 2024
1a76bd4
Add Missing return
apaniukov Jan 23, 2024
f2b2237
Turn off tokenizer message if not installed
apaniukov Jan 23, 2024
5e9c1b7
Update OpenVINO documentation about weight compression (#529)
AlexKoff88 Jan 24, 2024
3066ade
Merge branch 'main' into openvino-tokenizers
apaniukov Jan 24, 2024
d96ebfa
Fix ov device (#530)
echarlaix Jan 25, 2024
e0c1143
Fix expected quantization matmul test (#531)
echarlaix Jan 25, 2024
71610dd
Dev version
echarlaix Jan 25, 2024
a622f4d
Fix OVCasualLM model inference without generate (#532)
eaidova Jan 26, 2024
805e737
Add IPEX models (#516)
echarlaix Jan 26, 2024
87b36db
Add IPEX model for question answering (#534)
echarlaix Jan 26, 2024
6bf5fbc
Expose InferRequestWrapper class so it can be imported from elsewhere…
nikita-savelyevv Jan 29, 2024
9a2e271
Merge branch 'main' into openvino-tokenizers
apaniukov Jan 29, 2024
7ee347e
Move tokenizers to OV dependencies
apaniukov Jan 29, 2024
6e79be1
Add IPEX models for audio and image classification tasks (#536)
echarlaix Jan 29, 2024
20df723
relax requirements to have registered normalized config for usage con…
eaidova Jan 30, 2024
8d2ec41
Check OV Compatibility
apaniukov Jan 30, 2024
1b5c3cb
IPEX decoder model fix (#539)
echarlaix Jan 30, 2024
3b627f4
Enable loading of torchscript model with INC and add warning (#540)
echarlaix Jan 30, 2024
32a7274
Bump OV Version
apaniukov Jan 30, 2024
a251422
Fix torch version for ipex tests (#545)
echarlaix Jan 31, 2024
398450d
Refactor IPEX CausalLM for better model architecture scale (#544)
ofirzaf Jan 31, 2024
8ee487d
Automatic `torch.autocast` for IPEXModel (#542)
ofirzaf Jan 31, 2024
788e458
Add an initial warmup step to `IPEXModel`s (#543)
ofirzaf Jan 31, 2024
0ca9447
Fix format (#546)
echarlaix Jan 31, 2024
552de65
Dev version
echarlaix Jan 31, 2024
8c029e0
Move OpenVINO Tokenizers To Optional Dependencies
apaniukov Feb 1, 2024
7ea3656
Fix OV pre-commit test
daniil-lyakhov Feb 1, 2024
24f40bf
CUSTOMIZED_QUANTIZATION_CONFIG is updated
daniil-lyakhov Feb 2, 2024
5120f75
Merge pull request #548 from daniil-lyakhov/dl/fix_ov_precommit
AlexKoff88 Feb 5, 2024
0f45751
Update README (#549)
echarlaix Feb 5, 2024
ad99b98
Add bloom ipex inference test (#551)
echarlaix Feb 6, 2024
24a1e30
Remove pytorch v2.1.2 constraint for tests since ipex v2.2.0 release…
echarlaix Feb 6, 2024
e40e627
Fix openvino export model from ONNX (#554)
echarlaix Feb 7, 2024
09b067f
Add --convert-tokenizer Option to CLI
apaniukov Feb 8, 2024
a7b766e
Add load_in_4bit option for OVModelForCausalLM (#538)
AlexKoff88 Feb 8, 2024
1c14957
Skip automodel compression weights tests for nncf==2.8.0 (#535)
alexsu52 Feb 8, 2024
f3b8ce8
Merge branch 'main' into openvino_tokenizers
apaniukov Feb 8, 2024
3c27fbd
Fix SD Tokenizer
apaniukov Feb 8, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Bump OV Version
@apaniukov
apaniukov committed Jan 30, 2024
commit 32a7274ba2cb02138b5185b6501f6c1fbb1d345e
2 changes: 1 addition & 1 deletion setup.py
View file
Original file line number Diff line number Diff line change
@@ -45,7 +45,7 @@
"transformers>=4.34.0",
],
"openvino": [
"openvino>=2023.2",
"openvino>=2023.3",
"onnx",
"onnxruntime",
"transformers>=4.36.0",