Switch to ListObjectsV2

[redloaf]

Is your feature request related to a problem? Please describe.
Athens recently migrated the s3 storage provider from AWS SDK v1 to v2 but is still using ListObjects V1. This prevents athens from being used with directory buckets, including express one zone buckets. Using the V2 API would offer users more options to tune bucket type and data locality, potentially improving performance. Using EOZ buckets eliminates s3 prefix rate limiting and delivers great performance when the clients are in the same zone as the service and bucket. Similar workloads I've run with them saw p99 latency reduced by half and median latency reduced by as much as 85% when compared to using a standard s3 bucket.

Describe the solution you'd like
Change s3 operations to V2 so that athens can be used with a directory bucket (including an express one zone bucket).

Describe alternatives you've considered
Status quo, different storage backends, caching as in #1731.

Additional context

• May need to add default regional credentials to the credentials chain to support express one zone buckets because the endpoints may be zonal.