New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Evaluate trained models on GPU #96

Open

1 of 2 tasks

gsvgit opened this issue Sep 27, 2024 · 1 comment

Assignees

Member

gsvgit commented Sep 27, 2024 •

edited

Loading

ONNX allows one to execute trained models on GPU. It may increase performance of searcher (USVM, V#). It is important for

end users
new training strategy (@Parzival-05 )

Evaluate performance on

Server with 'big' GPU
Laptop with 'small' GPU

gsvgit assigned Anya497, ancavar and Parzival-05

gsvgit mentioned this issue

Compare performance of training processes #97

Open

2 tasks

gsvgit changed the title ~~Evaluate traned models on GPU~~ Evaluate trained models on GPU

Collaborator

Anya497 commented Nov 12, 2024

For V# and server GPU. Time to handle full evaluation dataset.

GPU ~194 min
CPU ~ 191 min
CPU+GPU ~ 199 min (CPU in single-thread ONNX evaluation mode)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment