About DEFAULT_BUFFER_SIZE, DEFAULT_MIN_PART_SIZE #720
Unanswered
vincent-herlemont
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I see here
DEFAULT_BUFFER_SIZE
is 128 Ko, andDEFAULT_MIN_PART_SIZE
is 50 Mo.That means that the smart_open read file with chunks of
16 Ko
and wait to have50 Mo
of chunks to send it to S3?So why
DEFAULT_BUFFER_SIZE != DEFAULT_MIN_PART_SIZE
?Beta Was this translation helpful? Give feedback.
All reactions