-
Notifications
You must be signed in to change notification settings - Fork 916
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Resolve confMerge branch 'main' into brynn/test-openai-1x
Signed-off-by: Brynn Yin <[email protected]>
- Loading branch information
Showing
45 changed files
with
790 additions
and
269 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,43 @@ | ||
# OpenAI GPT-4V | ||
|
||
## Introduction | ||
OpenAI GPT-4V tool enables you to leverage OpenAI's GPT-4 with vision, also referred to as GPT-4V or gpt-4-vision-preview in the API, to take images as input and answer questions about them. | ||
|
||
## Prerequisites | ||
|
||
- Create OpenAI resources | ||
|
||
Sign up account [OpenAI website](https://openai.com/) | ||
Login and [Find personal API key](https://platform.openai.com/account/api-keys) | ||
|
||
- Get Access to GPT-4 API | ||
|
||
To use GPT-4 with vision, you need access to GPT-4 API. Learn more about [How to get access to GPT-4 API](https://help.openai.com/en/articles/7102672-how-can-i-access-gpt-4) | ||
|
||
## Connection | ||
|
||
Setup connections to provisioned resources in prompt flow. | ||
|
||
| Type | Name | API KEY | | ||
|-------------|----------|----------| | ||
| OpenAI | Required | Required | | ||
|
||
## Inputs | ||
|
||
| Name | Type | Description | Required | | ||
|------------------------|-------------|------------------------------------------------------------------------------------------------|----------| | ||
| connection | OpenAI | the OpenAI connection to be used in the tool | Yes | | ||
| model | string | the language model to use, currently only support gpt-4-vision-preview | Yes | | ||
| prompt | string | The text prompt that the language model will use to generate it's response. | Yes | | ||
| max\_tokens | integer | the maximum number of tokens to generate in the response. Default is a low value decided by [OpenAI API](https://platform.openai.com/docs/guides/vision). | No | | ||
| temperature | float | the randomness of the generated text. Default is 1. | No | | ||
| stop | list | the stopping sequence for the generated text. Default is null. | No | | ||
| top_p | float | the probability of using the top choice from the generated tokens. Default is 1. | No | | ||
| presence\_penalty | float | value that controls the model's behavior with regards to repeating phrases. Default is 0. | No | | ||
| frequency\_penalty | float | value that controls the model's behavior with regards to generating rare phrases. Default is 0. | No | | ||
|
||
## Outputs | ||
|
||
| Return Type | Description | | ||
|-------------|------------------------------------------| | ||
| string | The text of one response of conversation | |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.