-
Notifications
You must be signed in to change notification settings - Fork 9
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add accuracy tests #73
Add accuracy tests #73
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## releases/1.1.0 #73 +/- ##
===============================================
Coverage 93.93% 93.94%
===============================================
Files 28 28
Lines 1897 1898 +1
===============================================
+ Hits 1782 1783 +1
Misses 115 115
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It looks good enough to me for current status.
I think we don't need to be too strict for the tests :)
5cf3879
into
openvinotoolkit:releases/1.1.0
pytest tests/perf/test_accuracy.py --dataset-data-root ... --dataset-ann-path ...
- Run on passed dataset (COCO, VOC, ILSVRC)pytest tests/perf/test_accuracy.py
- Run on internal toy dataset (cheetah_voc)convert_timm_to_ir
fromperf/test_performance.py
toperf/perf_tests_utils.py
to use in accuracy tests as wellTODO: