Skip to content

Commit

Permalink
Update evaluators.py to disable evaluate result artifact upload
Browse files Browse the repository at this point in the history
For some reasons, the current SP based authentication didn't have permission to read data storage -- we tried: the SP is contributor to the AI hub and SP was added separately into the key vault, but still not working.
  • Loading branch information
YusakuNo1 authored Nov 13, 2024
1 parent 832aaa5 commit 77716ae
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions src/api/evaluate/evaluators.py
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ def __call__(self, *, data_path, **kwargs):
data=data_path,
evaluators=self.evaluators,
## NOTE: If you do not have Storage Blob Data Contributor permissions, please comment out the below line of code.
azure_ai_project=self.project_scope,
# azure_ai_project=self.project_scope,
evaluator_config={
"relevance": {
"column_mapping": {
Expand Down Expand Up @@ -234,4 +234,4 @@ def evaluate_image(messages):
print("results: ", resultsJson)




1 comment on commit 77716ae

@marlenezw
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can update the permissions to allow this for the SP. I'm reverting these changes because the evals are needed for other teams talks

Please sign in to comment.