Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does S3 iter_bucket function support custom s3 endpoint_url? #740

Open
phatvo2015 opened this issue Nov 21, 2022 · 2 comments
Open

Does S3 iter_bucket function support custom s3 endpoint_url? #740

phatvo2015 opened this issue Nov 21, 2022 · 2 comments

Comments

@phatvo2015
Copy link

Hi! Is there anyway to pass custom s3 endpoint url for module s3's function iter_bucket. As I see, so far it only allows to pass session kwargs - https://github.com/RaRe-Technologies/smart_open/blob/develop/smart_open/s3.py#L1107 . It would be nice if endpoint url is supported so that we can test against our mock S3 bucket server.

@gjedlicska
Copy link

Plus one for this feature. It would be nice to be able to pass in the client / resource kwargs along the session kwargs.

@5t33
Copy link

5t33 commented Nov 26, 2023

For anyone stuck on this thread, Boto3 now supports environment variable AWS_ENDPOINT_URL_S3 as of 1.28.0. This worked as a workaround for me using localstack s3.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants