Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unsupported qwen2_5_vl #1845

Open
nvsreerag opened this issue Mar 5, 2025 · 1 comment
Open

Unsupported qwen2_5_vl #1845

nvsreerag opened this issue Mar 5, 2025 · 1 comment
Assignees
@Wovchena
Labels
category: visual language Visual language pipeline

Comments

@nvsreerag
Copy link

nvsreerag commented Mar 5, 2025 •
edited
Loading

I tried quantizing the Qwen/Qwen2.5-VL-3B-Instruct using the below command

optimum-cli export openvino --model Qwen/Qwen2.5-VL-3B-Instruct Qwen2.5-VL-3B-Instruct\INT4 --weight-format int4

I tried inferring the quantized model using openvino.genai VLM example and getting the below error.

Unsupported 'qwen2_vl' VLM model type
@ilya-lavrenov ilya-lavrenov added the category: visual language Visual language pipeline label Mar 5, 2025
@ilya-lavrenov
Copy link
Contributor

Hi @nvsreerag
This model is not listed in supported models, but we are planning to add it in mean time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Wovchena Wovchena

Labels
category: visual language Visual language pipeline
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@ilya-lavrenov @Wovchena @nvsreerag