Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Tombstone clean "repair" process #67

Open
danthegoodman1 opened this issue Aug 6, 2023 · 0 comments
Open

Tombstone clean "repair" process #67

danthegoodman1 opened this issue Aug 6, 2023 · 0 comments
Labels
enhancement New feature or request help wanted Extra attention is needed
Milestone
v3.1

Comments

@danthegoodman1
Copy link
Owner

Because S3 does not tell us whether something was actually deleted, there is a case where the object delete fails for some reason, and we just don't know.

We can create a repair process that will go over everything in all log files, and find the set of files in s3 that are not listed in the log files. This would be the set of missed deletions, and they can be safely deleted as there is no use for those files.
@danthegoodman1 danthegoodman1 added the enhancement New feature or request label Aug 6, 2023
@danthegoodman1 danthegoodman1 changed the title Repair process Tombstone clean "repair" process Aug 6, 2023
@danthegoodman1 danthegoodman1 added the help wanted Extra attention is needed label Aug 13, 2023
@danthegoodman1 danthegoodman1 added this to the v3.1 milestone Aug 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Milestone
v3.1
Development

No branches or pull requests
1 participant
@danthegoodman1