Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Initiate S3 Multi-part upload on receiving first event #318

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

Initiate S3 Multi-part upload on receiving first event #318

wants to merge 3 commits into from

Commits on Oct 23, 2024

  1. This update initiates the multipart upload as soon as a record begins… 

    …, and closes the file on flush.

Signed-off-by: Aindriu Lavelle <[email protected]>
    @aindriu-aiven
    aindriu-aiven committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    4776d6d View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. Add compatibility for compact records to update only on flush. While … 

    …allowing changelog records to initiate multipart upload.

Signed-off-by: Aindriu Lavelle <[email protected]>
    @aindriu-aiven
    aindriu-aiven committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    f719afd View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. Reduce S3 memory usage by clearing records already sent to S3 

    Signed-off-by: Aindriu Lavelle <[email protected]>
    @aindriu-aiven
    aindriu-aiven committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    b4e06fd View commit details
    Browse the repository at this point in the history