Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Training ImageNet-1K #20

Open
nlrahimi opened this issue Feb 3, 2023 · 0 comments
Open

Training ImageNet-1K #20

nlrahimi opened this issue Feb 3, 2023 · 0 comments

Comments

@nlrahimi
Copy link

nlrahimi commented Feb 3, 2023

Hi, Thanks for the amazing work. I enjoyed reading your paper.
Running experiments I wanted to train ImageNet-1k using some baseline methods you have kindly shared the implementation for. However, I noticed ImageNet-100 is loaded in a pickle file, unlike frameworks that use dataloader for imagenet to load batches in a few phases. The problem is that when it comes to ImageNet1k its not possible to load all data at once.
My question is how can I use dataloaders in Mini_ImageNet class in continuum/dataset_scripts structure, in a way that it does not disrupt other functions in relevant codes?

`
class Mini_ImageNet(DatasetBase):

 def __init__(self, scenario, params): 

 def download_load(self):

 def new_task(self, cur_task, **kwargs):

        elif self.scenario == 'nc':

            labels = self.task_labels[cur_task]

            x_train, y_train = load_task_with_labels(self.train_data, self.train_label, labels)

        return x_train, y_train, labels

`

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant