Skip to content

Commit

Permalink
Configure Azure Developer Pipeline
Browse files Browse the repository at this point in the history
  • Loading branch information
marlenezw committed Aug 19, 2024
1 parent 41a674d commit 78558f3
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 5 deletions.
2 changes: 1 addition & 1 deletion src/api/evaluate/eval_results.jsonl
Original file line number Diff line number Diff line change
@@ -1 +1 @@
[{"research_context": "Can you find the latest camping trends and what folks are doing in the winter?", "gpt_relevance": 4.0, "gpt_fluency": 5.0, "gpt_coherence": 5.0, "gpt_groundedness": 5.0}, {"research_context": "Can you find the latest trends in hiking shoes?", "gpt_relevance": 3.0, "gpt_fluency": 5.0, "gpt_coherence": 5.0, "gpt_groundedness": 1.0}, {"research_context": "Find information about the best snow camping spots in the world", "gpt_relevance": 3.0, "gpt_fluency": 5.0, "gpt_coherence": 5.0, "gpt_groundedness": 5.0}]
[{"research_context": "Can you find the latest camping trends and what folks are doing in the winter?", "gpt_relevance": 5.0, "gpt_fluency": 5.0, "gpt_coherence": 5.0, "gpt_groundedness": 5.0}, {"research_context": "Can you find the latest trends in hiking shoes?", "gpt_relevance": 3.0, "gpt_fluency": 5.0, "gpt_coherence": 5.0, "gpt_groundedness": 1.0}, {"research_context": "Find information about the best snow camping spots in the world", "gpt_relevance": 4.0, "gpt_fluency": 5.0, "gpt_coherence": 5.0, "gpt_groundedness": 1.0}]
8 changes: 4 additions & 4 deletions src/api/evaluate/eval_results.md
Original file line number Diff line number Diff line change
@@ -1,14 +1,14 @@
| | research_context | gpt_relevance | gpt_fluency | gpt_coherence | gpt_groundedness |
|---:|:-------------------------------------------------------------------------------|----------------:|--------------:|----------------:|-------------------:|
| 0 | Can you find the latest camping trends and what folks are doing in the winter? | 4 | 5 | 5 | 5 |
| 0 | Can you find the latest camping trends and what folks are doing in the winter? | 5 | 5 | 5 | 5 |
| 1 | Can you find the latest trends in hiking shoes? | 3 | 5 | 5 | 1 |
| 2 | Find information about the best snow camping spots in the world | 3 | 5 | 5 | 5 |
| 2 | Find information about the best snow camping spots in the world | 4 | 5 | 5 | 1 |

Averages scores:

| | 0 |
|:-----------------|--------:|
| gpt_relevance | 3.33333 |
| gpt_relevance | 4 |
| gpt_fluency | 5 |
| gpt_coherence | 5 |
| gpt_groundedness | 3.66667 |
| gpt_groundedness | 2.33333 |

0 comments on commit 78558f3

Please sign in to comment.