Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

not able to convert DeepSeek-R1 into Onnx using optimum-cli #2215

Open
2 of 4 tasks
volcano619 opened this issue Mar 13, 2025 · 0 comments
Open
2 of 4 tasks

not able to convert DeepSeek-R1 into Onnx using optimum-cli #2215

volcano619 opened this issue Mar 13, 2025 · 0 comments
Labels
bug Something isn't working

Comments

@volcano619
Copy link

System Info

v1.24.0

Who can help?

@michaelbenayoun

I'm trying to convert DeepSeek-R1 into a onnx format, but i'm being presented with

ValueError: Loading deepseek-ai/DeepSeek-R1 requires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option trust_remote_code=True to remove this error.

I'm trying to do this using optimum-cli

optimum-cli export onnx --model deepseek-ai/DeepSeek-R1 --task causal-lm C:\DeepSeek-R1-Onnx

Can i somehow enable this using cli, or do i have to manually download the model into my system and using cli i would have to perform onnx instead of repo link

if yes, then how can i enable trust_remote_code=True once i download the repo?

Information

  • The official example scripts
  • My own modified scripts

Tasks

  • An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • My own task or dataset (give details below)

Reproduction (minimal, reproducible, runnable)

optimum-cli export onnx --model deepseek-ai/DeepSeek-R1 --task causal-lm C:\DeepSeek-R1-Onnx

Running this command doesn't provide an output

Expected behavior

The conversion should start for DeepSeek-R1 to ONNX

@volcano619 volcano619 added the bug Something isn't working label Mar 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant