-
Notifications
You must be signed in to change notification settings - Fork 133
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add importers grouping by file extensions (#1268)
<!-- Contributing guide: https://github.com/openvinotoolkit/datumaro/blob/develop/CONTRIBUTING.md --> ### Summary CVS-126682 This PR introduces grouping of importers by the required file extensions in dataset directory tree to speed up the detection process. | File Extension | # of importers | | --- | --- | | `.txt` | 24 | | `.json` | 23 | | `.png` | 17 | | `.jpg` | 9 | | `.csv` | 8 | | `.xml` | 4 | | `.sr`, `.hdr`, `.dib`, `.tiff`, `.pgm`, `.bmp`, `.tga`, `.tif`, `.jpe`, `.pnm`, `.webp`, `.pxm`, `.pbm`, `.jp2`, `.jpeg`, `.ppm`, `.ras`, `.exr`, `.pfm`, `.pic` | 3 | | `.gz`, `.tfrecord`, `.mpeg`, `.f4v`, `.m2p`, `.ps`, `.mp4`, `.ogx`, `.wmv`, `.vob`, `.m2ts`, `.3g2`, `.qt`, `.webm`, `.mk3d`, `.divx`, `.mov`, `.mkv`, `.3gp`, `.ogg`, `.evo`, `.ogv`, `.mpg`, `.ts`, `.asf`, `.mxf`, `.avi`, `.rmvb`, `.flv` | 2 | | `.p`, ` `, `.meta`, `.datum`, `.arrow`, `.zip`, `.mat`, `.h5`, `data` | 1 | Total number of importers: 74. The groups listed above can intersect. ### Checklist <!-- Put an 'x' in all the boxes that apply --> - [ ] I have added unit tests to cover my changes. - [ ] I have added integration tests to cover my changes. - [ ] I have added the description of my changes into [CHANGELOG](https://github.com/openvinotoolkit/datumaro/blob/develop/CHANGELOG.md). - [ ] I have updated the [documentation](https://github.com/openvinotoolkit/datumaro/tree/develop/docs) accordingly ### License - [x] I submit _my code changes_ under the same [MIT License](https://github.com/openvinotoolkit/datumaro/blob/develop/LICENSE) that covers the project. Feel free to contact the maintainers if that's a concern. - [x] I have updated the license header for each file (see an example below). ```python # Copyright (C) 2023 Intel Corporation # # SPDX-License-Identifier: MIT ``` --------- Signed-off-by: Ilya Trushkin <[email protected]>
- Loading branch information
Showing
63 changed files
with
1,225 additions
and
713 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.