Added the azure openai proxy resource endpoint

[edwardcqian]

Implements #55

Added proxy implementation for Azure OpenAI

User can opt to use Azure OpenAI backend updating the following logics:

• Turn on the Use Azure OpenAI toggle
• Setting the correct URL and corresponding api-key
• Adding the model mapping (each OpenAI model should be mapped to a Azure deployment)

No changes required on the frontend.

[CLAassistant]

All committers have signed the CLA.

[sd2k]

We'll need to add some options to the config page to handle this too.

I'm not sure whether we should support multiple providers being configured at the same time... right now I don't see why not though!

[sd2k]

It might be nicer to use an open type here rather than a bool. Something like

type openAIType string

const (
	openAITypeOpenAI openAIType "openai"
	openAITypeAzure  openAIType "azure"
)

above, then

Suggested change

	UseAzure bool `json:"azureOpenAI"`
	Type openAIType `json:"type"`

in the settings.

(in case in future people want support for other providers which look and act like OpenAI)

[sd2k]

This will need rebasing on main where there are some important changes in path handling in stream.go - basically when creating the path we should no longer use the request's path, instead we should just hardcode /chat/completions.

[edwardcqian]

@sd2k Attempted to try handling the proxy errors, but couldn't really find a good working method. currently just collecting the errors and logging.

[sd2k]

Yeah that is a bit annoying, guess there's not much more we can do? I wonder if anyone else has encountered this while using Go's HTTP proxy...

Looks like there's 1 unhandled error still left btw 🙏

[edwardcqian]

Yeah that is a bit annoying, guess there's not much more we can do? I wonder if anyone else has encountered this while using Go's HTTP proxy...

Looks like there's 1 unhandled error still left btw 🙏

Found the last unhandled error

[sd2k]

@edwardcqian I found a way to nicely return early if we can't parse the URL, unmarshal the body, find a matching deployment, etc. Added a few tests too. I think this is good to go now, but could you test it out when you get a chance?

need to think about the useAzure flag

[sd2k]

Let's get this merged, I'll take a look at switching the useAzure boolean to an open type in a separate PR.