Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Which MVimgNet classes to intersect with Imagenet dataset classes? #32

Open
jesimonbarreto opened this issue Jul 2, 2024 · 6 comments

Comments

@jesimonbarreto
Copy link

Hello,
Thank you for making the dataset available. I tried to find the same classes in both datasets using the list available but the number is lower than what was reported in the text.

"The objects in our MVImgNet are found or
used in human daily life (human-centric), where 65 classes
overlap with ImageNet."

Could you make it clear what these classes are in MVImgnet. Also, if possible, make them available in a folder separately for download, please?

Thank you.

@mutianxu
Copy link
Contributor

mutianxu commented Jul 2, 2024

Thanks for your question.

In fact, we provide "MVImgNet_by_categories" just for partial debugging/testing on specific categories, so it is incomplete. Please also note that splitting the classes is highly nontrivial, so currently, we can only provide limited categories.

To access all categories (65 classes, detailed in the supplementary material of the paper), you need to download all the mvi_xxx.zip files directly.

We have provided the Linux download script in README, so it will be very convenient now.

Hope this is helpful!

@jesimonbarreto
Copy link
Author

Thanks for the answer. I looked at the supplementary material but couldn't find the 65 categories exactly. Could you tell me exactly where this detail is in the paper, please?

Thank you so much!

@mutianxu
Copy link
Contributor

mutianxu commented Jul 3, 2024

Sorry for the confusion!

So, we actually manually compare our categories with ImageNet categories.

Here is the category list of MVImgNet, you can compare it with ImageNet by yourself.

mvimgnet_category.txt

Thanks!

@jesimonbarreto
Copy link
Author

I compared the class names, but the total is less than 65 classes.

Is there any detail beyond direct comparison of names?

Thank you for your attention and answers!

@matheusfreitasmv
Copy link

Hello,

I have the same question. I couldn't find the 65 classes that overlap with ImageNet.

Is it possible to provide these overlapped classes, please?

Thank you.

@mutianxu
Copy link
Contributor

Hi,

Sorry, we actually manually compare each class (very burdensome and non-trivial), it does not require "literally same" classes, but just consider very similar classes that may denote the same object.

Therefore, a very simple method is to send the category text of both MVImgNet and ImageNet to CLIP, and calculate the similarities in the latent space.

These are all the suggestions we can provide at this time.

Hope this is helpful to you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants