[BUG] invalid URL escape

[prestonr83]

Note: Make sure to check out known issues (https://akv2k8s.io/troubleshooting/known-issues/) before submitting

Components and versions
Select which component(s) the bug relates to with [X].

[ ] Controller, version: 1.5.0-beta.6 (docker image tag)
[X ] Env-Injector (webhook), version: 1.5.0-beta.6 (docker image tag)
[ ] Other

Describe the bug
Sporadically a pod will fail to come online failing with an error of invalid URL escape. However deleting the pod and having it recreate resolves the problem. Restarts of the existing pod does not work it just crash loops
To Reproduce
Steps to reproduce the behavior:
Unable to reproduce manually. Seems to happen sporadically.

Expected behavior
Environement Injector works as expected.

Logs
If applicable, add logs to help explain your problem.

Pod Logs

I0925 14:38:53.521742       1 version.go:31] "version info" version="" commit="11d9861" buildDate="2022-04-18T15:59:28Z" component="vaultenv"
I0925 14:38:53.521956       1 main.go:184] "azure key vault env injector initializing"
I0925 14:38:53.522265       1 main.go:253] "found original container command" cmd="/usr/bin/dotnet" args=[dotnet cs.Service.Autoquoting.dll]
I0925 14:38:53.522388       1 authentication.go:98] "checking if current auth service credentials are stale" url="http://akv2k8s-envinjector.akv2k8s.svc:80/auth/autoquoting/cs-autoquoting-67ff4c4c56-4wptf?secret=akv2k8s-cs-autoquoting"
I0925 14:38:53.592012       1 authentication.go:111] "auth service credentials ok" url="http://akv2k8s-envinjector.akv2k8s.svc:80/auth/autoquoting/cs-autoquoting-67ff4c4c56-4wptf?secret=akv2k8s-cs-autoquoting"
I0925 14:38:53.592272       1 authentication.go:147] "requesting azure key vault oauth token" url="https://akv2k8s-envinjector.akv2k8s.svc:9443/auth/autoquoting/cs-autoquoting-67ff4c4c56-4wptf"
I0925 14:38:53.622839       1 authentication.go:167] "successfully received oauth token"
E0925 14:38:53.646406       1 main.go:347] "failed to read secret from azure key vault" err="keyvault.BaseClient#GetSecret: Failure preparing request: StatusCode=0 -- Original Error: parse \"%!(EXTRA string=webVault1)\": invalid URL escape \"%!(\"" azurekeyvaultsecret="autoquoting/loganalyticskey"

Env Injector Logs

I0925 05:15:08.654388       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 05:20:12.650975       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 05:40:46.650295       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 06:01:07.671173       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 06:06:18.666163       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 06:11:29.635556       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 06:16:36.612907       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 06:21:39.657783       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 06:26:50.615475       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 06:32:02.649676       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 06:37:16.609454       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 06:42:23.618670       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 06:47:26.632234       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 07:02:57.651368       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 07:07:59.862172       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 07:13:00.647149       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 07:18:02.615435       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 07:43:30.633556       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 07:48:38.659511       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 07:53:48.668101       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 07:58:57.738858       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 08:04:11.635890       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 08:09:22.616571       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 08:19:47.707443       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 08:24:49.714571       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 08:29:58.734045       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 08:45:21.662549       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 08:50:22.667093       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 09:00:33.672057       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 09:05:42.643008       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 09:10:50.629993       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 09:20:57.769647       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 09:26:08.610524       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 09:46:37.767062       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 09:51:50.624221       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 09:56:59.709126       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 10:07:13.650482       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 10:17:28.632976       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 10:32:47.709895       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 10:37:51.678679       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 11:03:20.628325       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 11:13:30.599939       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 11:18:40.627608       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 11:34:08.662123       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 11:39:20.641567       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 11:49:47.620629       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 11:54:49.640747       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 11:59:56.644870       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 12:40:53.597557       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 12:45:54.620291       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 12:56:08.619622       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 13:01:16.639504       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 13:11:37.633757       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 13:21:52.747554       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 13:26:59.641840       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 13:32:01.648907       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 13:37:14.663075       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 14:03:06.654846       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 14:08:16.631461       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 14:23:31.782905       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 14:28:41.653800       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 14:33:50.627198       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 14:38:53.622136       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"
I0925 14:44:07.650176       1 auth.go:148] "served oauth token" pod="cs-autoquoting-67ff4c4c56-4wptf" namespace="autoquoting"

Additional context
Add any other context about the problem here.

[wsmelton]

Hit this bug on a QA cluster deployment that was just upgraded to the 2.6.0 helm chart which is running 1.6.0 images.

E0501 02:10:55.376604       1 main.go:347] "failed to read secret from azure key vault"
err="keyvault.BaseClient#GetSecret: Failure preparing request: StatusCode=0 --
Original Error: parse \"%!(EXTRA string={keyvault_name})\":
invalid URL escape \"%!(\"" azurekeyvaultsecret="{namespace}/{akv2k8s_secret_name}"

Resolution on this instance was a rollout restart of the deployment caused it to pull the secret correctly.