Switch to ListObjectsV2 #1991
Labels
enhancement
New feature or request
good first issue
Great issues for new Athenians to work on!
help wanted
Extra attention is needed
Is your feature request related to a problem? Please describe.
Athens recently migrated the s3 storage provider from AWS SDK v1 to v2 but is still using
ListObjects
V1. This prevents athens from being used with directory buckets, including express one zone buckets. Using the V2 API would offer users more options to tune bucket type and data locality, potentially improving performance. Using EOZ buckets eliminates s3 prefix rate limiting and delivers great performance when the clients are in the same zone as the service and bucket. Similar workloads I've run with them saw p99 latency reduced by half and median latency reduced by as much as 85% when compared to using a standard s3 bucket.Describe the solution you'd like
Change s3 operations to V2 so that athens can be used with a directory bucket (including an express one zone bucket).
Describe alternatives you've considered
Status quo, different storage backends, caching as in #1731.
Additional context
The text was updated successfully, but these errors were encountered: