Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add slice_with_offset and dry_run Support for Tar Dataset Creation; New Script for Partial Conversion #10511

Closed
wants to merge 18 commits into from
Closed

Add slice_with_offset and dry_run Support for Tar Dataset Creation; New Script for Partial Conversion #10511

Show file tree
Hide file tree
Changes from 13 commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
cc3594a
Partial tarring
ssh-meister Sep 16, 2024
170dcab
Partial tarring
ssh-meister Sep 16, 2024
e7e06f6
Fixed logic
ssh-meister Sep 16, 2024
126d52a
Debugged, tested and docstrings added
ssh-meister Sep 17, 2024
2c6d629
Apply isort and black reformatting
ssh-meister Sep 17, 2024
fb5ac5d
Merge branch 'main' into partial_tar
ssh-meister Sep 17, 2024
a963ae1
Merge branch 'main' into partial_tar
ssh-meister Sep 17, 2024
03bf3b2
Merge branch 'main' into partial_tar
ssh-meister Sep 18, 2024
42e989c
Merge branch 'main' into partial_tar
ssh-meister Sep 19, 2024
c073ddf
Fixed FileNotFoundError for metadata saving
ssh-meister Sep 19, 2024
d9aef91
Apply isort and black reformatting
ssh-meister Sep 19, 2024
d7d615e
Reverse to previous commit due to wrong script idea interpretation
ssh-meister Sep 19, 2024
0b9c294
Apply isort and black reformatting
ssh-meister Sep 19, 2024
4bd7ff1
Added slice_with_offset to PartialASRTarredDatasetConfig
ssh-meister Sep 29, 2024
22bdbea
Apply isort and black reformatting
ssh-meister Sep 29, 2024
9c05c03
tmp tqdm addition for debugging
ssh-meister Sep 30, 2024
55a9a85
Apply isort and black reformatting
ssh-meister Sep 30, 2024
f4b44e4
Fix typo
ssh-meister Sep 30, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading