Skip to content

Commit

Permalink
vstrt/vs_tensorrt.cpp: share optimization profile when using dynamic …
Browse files Browse the repository at this point in the history
…shapes
  • Loading branch information
WolframRhodium committed May 18, 2024
1 parent de31928 commit ba84703
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions vstrt/vs_tensorrt.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -445,6 +445,8 @@ static void VS_CC vsTrtCreate(
is_dynamic
);

// https://docs.nvidia.com/deeplearning/tensorrt/archives/tensorrt-1000-ea/developer-guide/index.html#perform-inference
#if NV_TENSORRT_MAJOR < 10
// duplicates ICudaEngine instances
//
// According to
Expand All @@ -458,6 +460,7 @@ static void VS_CC vsTrtCreate(
return set_error(std::get<ErrorMessage>(maybe_engine));
}
}
#endif // NV_TENSORRT_MAJOR < 10

if (std::holds_alternative<InferenceInstance>(maybe_instance)) {
auto instance = std::move(std::get<InferenceInstance>(maybe_instance));
Expand Down

0 comments on commit ba84703

Please sign in to comment.