Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[QAT Lora 5/N] Fixes for loading/saving compression checkpoint #3341

Open
wants to merge 5 commits into
base: develop
Choose a base branch
from

Conversation

ljaljushkin
Copy link
Contributor

Changes

Added test for loading/saving compression checkpoint. Fixed revealed errors with different device and invalid lora rank.

Reason for changes

Compression module and the corresponding layer may have a different device in multi-device setup (e.g. when HF model was loaded with device_map='auto'). Need to align devices.

Related tickets

154907

Tests

  • test_checkpoint_loading
  • test_invalid_lora_rank

@ljaljushkin ljaljushkin requested a review from a team as a code owner March 13, 2025 19:57
@github-actions github-actions bot added NNCF PT Pull requests that updates NNCF PyTorch NNCF Common Pull request that updates NNCF Common experimental NNCF OpenVINO Pull requests that updates NNCF OpenVINO NNCF PTQ Pull requests that updates NNCF PTQ API Public API-impacting changes labels Mar 13, 2025
@alexsu52 alexsu52 requested a review from daniil-lyakhov March 14, 2025 07:14
@github-actions github-actions bot removed NNCF Common Pull request that updates NNCF Common experimental NNCF OpenVINO Pull requests that updates NNCF OpenVINO API Public API-impacting changes labels Mar 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Code Freeze NNCF PT Pull requests that updates NNCF PyTorch NNCF PTQ Pull requests that updates NNCF PTQ
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants