Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RuntimeError with OpenVINOExecutionProvider on Windows when using ORTModelForSeq2SeqLM #468

Open
prasad-pr-20 opened this issue Oct 7, 2024 · 3 comments

Comments

@prasad-pr-20
Copy link

Environment Info:

  • OS: Windows
  • Optimum==1.22.0
  • ONNX version==1.16.2
  • Python version: 3.9.19
  • ONNX Runtime version: 1.19.0
  • onnxrumtime-openvino==1.14.0
  • OpenVINO version: 2024.4.0

Issue Description
I'm encountering a runtime error when trying to use the ORTModelForSeq2SeqLM class provided by Optimum-ONNX with the OpenVINOExecutionProvider.
The issue arises when executing the following line of code: model_1 = ORTModelForSeq2SeqLM.from_pretrained("optimum/m2m100_418M", provider='OpenVINOExecutionProvider')
The error message is as follows:
RuntimeError: C:\Users\iei\Desktop\vishnu\wheel_build_after_doc_update\onnxruntime\onnxruntime\core\session\provider_bridge_ort.cc:1103 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 127 "" when trying to load "C:\Users\username\Downloads\path\path\open_vin\lib\site-packages\onnxruntime\capi\onnxruntime_providers_openvino.dll".

It's peculiar that the error message includes a different username in the file path, which does not match my machine's username.

Steps to Reproduce

  • Enabled the OpenVINO environment using setvars.bat.
  • Installed necessary packages with the following command: pip install onnx onnxruntime onnxruntime-openvino
  • Confirmed that onnxruntime_providers_openvino.dll is present in the specified directory.

Additional Context

  • I have successfully used DmlExecutionProvider and CPUExecutionProvider with the same setup.
  • The goal is to run the model with OpenVINOExecutionProvider.

Any assistance in resolving this issue would be greatly appreciated.

@sfatimar
Copy link

It seems openvino is not installed ?

@prasad-pr-20
Copy link
Author

OpenVINO is installed and the version is 2024.4.0.

@vthaniel
Copy link

The onnxruntime-openvino wheel version seems to be quite old
"onnxruntime-openvino==1.14.0"

Can you use the latest one (1.19.0) and use OV2024.3 (latest onnxruntime-openvino version officially supports OV 2024.3)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants