Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The results of ID CIFAR100-> OOD CIFAR10 #1

Open
ZhimaoPeng opened this issue May 25, 2023 · 3 comments
Open

The results of ID CIFAR100-> OOD CIFAR10 #1

ZhimaoPeng opened this issue May 25, 2023 · 3 comments

Comments

@ZhimaoPeng
Copy link

ZhimaoPeng commented May 25, 2023

After Fine-tuning on the CIFAR100 with the model that are self-supervised pretrained and then intermediate fine-tuned on ImageNet-22k, I got the 87.169 AUROC for ID CIFAR100-> OOD CIFAR10, this is a significant difference from the 98.3 AUROC reported in the paper, How can I get normal results?
The command line I ran and the results are shown below:

command line:

OMP_NUM_THREADS=1 python -m torch.distributed.launch --nproc_per_node=2 run_class_finetuning.py --model beit_base_patch16_224 --data_path /home/ubuntu/code/open-set/MOOD --data_set cifar100 --nb_classes 100 --disable_eval_during_finetuning --finetune /home/ubuntu/code/open-set/MOOD/beit_base_patch16_224_pt22k_ft22k.pth --output_dir logs_cifar100_test --batch_size 128 --lr 1.5e-3 --update_freq 1 --warmup_epochs 5 --epochs 90 --layer_decay 0.65 --drop_path 0.2 --weight_decay 0.05 --layer_scale_init_value 0.1 --clip_grad 3.0

results:

results_test

@Mohammadakhavan75
Copy link

Hello,
I have a problem running the model.
I am getting an error related to visualizer package:

ImportError: cannot import name 'get_local' from 'visualizer' (/opt/conda/lib/python3.8/site-packages/visualizer.py)

Didn't you face this problem?
Which version of visualizer is installed on your environment and how did you install it?

@GMR523
Copy link

GMR523 commented Aug 17, 2023

Hello, I have a problem running the model. I am getting an error related to visualizer package:

ImportError: cannot import name 'get_local' from 'visualizer' (/opt/conda/lib/python3.8/site-packages/visualizer.py)

Didn't you face this problem? Which version of visualizer is installed on your environment and how did you install it?

This is the link to the visualizer package, https://github.com/luo3300612/Visualizer/tree/main

@Mohammadakhavan75
Copy link

Thank you for your response.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants