Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Enable quant model support #1074
Enable quant model support #1074
Changes from 53 commits
3888824
f9fa807
202df43
4488073
16fecf8
de501f4
4225bf0
2ac7ecf
24b988c
5c4f9a1
46b93a4
82d39ce
7dc08da
30027ff
314db04
87656ca
9a7e931
b0cec9c
94cf35d
9af46d1
18b2a6a
9f6db33
6d8a969
dd811f9
d91eefb
f094cad
dab4a78
6bf3b8b
356d51d
d1eee87
3aece6a
57e3c27
8f6ba5c
8870714
5828fc0
c616d57
e1715b8
e88faf2
882f2b2
d8208c7
80b9ccb
f05fb2f
bd8e870
e471be3
96f4622
32bf0a1
ad3467b
4a21d26
fb8002c
2ad2371
3c2ddef
757ea8c
0a6ab0f
8c4884b
7fa23a5
5386bbe
c5f5d16
41513f0
8e1caa2
f73c08d
f51777b
f64b251
778bf15
6ba1895
88dba29
File filter
Filter by extension
Conversations
Jump to
There are no files selected for viewing
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
no luck with autoawq ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, the autoawq installation have some issues, I will figure out why this env cannot install autoawq. But the tests passed in my local env which have the autoawq installed.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
why no longer patching the mlp and attention here ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Because they are in the _IPEXGPT2Block