[Bug]: benchmark_app is crashing on NPU with Yolov10s

[tbujewsk]

OpenVINO Version

2024.4.0-16579-c3152d32c9c-releases/2024/4

Operating System

Other (Please specify in description)

Device used for inference

NPU

Framework

None

Model used

YOLOv10

Issue description

Getting the following error while running Yolov10s on NPU [Intel(R) Core(TM) Ultra 7 155H; Ubuntu 22.04, 6.8.12-060812-generic ]

[ ERROR ] Exception from src/inference/src/cpp/core.cpp:104:
Exception from src/inference/src/dev/plugin.cpp:53:
Exception from src/plugins/intel_npu/src/plugin/src/plugin.cpp:697:
Exception from src/plugins/intel_npu/src/plugin/src/compiled_model.cpp:62:
Exception from src/plugins/intel_npu/src/compiler/src/zero_compiler_in_driver.cpp:848:
L0 pfnCreate2 result: ZE_RESULT_ERROR_UNKNOWN, code 0x7ffffffe

Step-by-step reproduction

1. download Yolov10s

from ultralytics import YOLO
pt_model = YOLO("yolov10s.pt")
pt_model.export(format='openvino', half=True)  # creates 'yolov10s_openvino_model/'

2. run benchmark app
   benchmark_app -t 10 -nireq 1 -b 1 -d NPU -inference_only=false -hint throughput -m ./yolov10s_openvino_model/yolov10s.xml

Relevant log output

No response

Issue submission checklist

• I'm reporting an issue. It's not a question.
• I checked the problem with the documentation, FAQ, open issues, Stack Overflow, etc., and have not found a solution.
• There is reproducer code and related data files such as images, videos, models, etc.

[avitial]

Hi @tbujewsk thanks for reaching out. Please note YoloV10 model is currently not supported by NPU plugin, so what you observe is the expected behavior.

The UD40 NPU driver expects to add support to this YoloV10 model on NPU, such driver is targeted to be out on ~WW40'24. Sorry for the inconvenience this may cause, keep an eye on release notes for the driver.

Ref. 148881

[tbujewsk]

What is the UD40? Thank you

[avitial]

@tbujewsk sorry UD40 pertains to the internal name, the driver name it corresponds to is 32.0.100.3053. The driver is trending to be out pretty soon, and it should address this issue. Hope this helps.