Skip to content

Commit 12dc672

Browse files
Add note about possibility of skipping AWQ
1 parent a44c096 commit 12dc672

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

optimum/commands/export/openvino.py

+3-1
Original file line numberDiff line numberDiff line change
@@ -135,7 +135,9 @@ def parse_args_openvino(parser: "ArgumentParser"):
135135
default=None,
136136
help=(
137137
"Whether to apply AWQ algorithm. AWQ improves generation quality of INT4-compressed LLMs, but requires "
138-
"additional time for tuning weights on a calibration dataset. To run AWQ, please also provide a dataset."
138+
"additional time for tuning weights on a calibration dataset. To run AWQ, please also provide a dataset "
139+
"argument. Note: it's possible that there will be no matching patterns in the model to apply AWQ, in such "
140+
"case it will be skipped."
139141
),
140142
)
141143
optional_group.add_argument(

0 commit comments

Comments
 (0)