-
Notifications
You must be signed in to change notification settings - Fork 2.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add MedImg for streaming #6912
Comments
@mariosasko, @lhoestq, @albertvillanova |
Hi ! Feel free to download the dataset and create a Then your'll be able to use |
The dataset is several TB in total, which I do not have the resources to handle. |
Hi @lhoestq and @albertvillanova , just following up about this. |
for big datasets you can push_to_hub one part at a time (e.g. as different splits) and merge the parts (just a simple modification in the YAML part of the README) |
Sure, that makes sense. However, isn't there a size limit to what typical users can push? |
Yes there is a limit, simply let us know by email at datasets [at] huggingface.co - this way we can give you a storage grant also help making sure the dataset is all good for people to use it easily |
Got it, that would be great. |
Feature request
Host the MedImg dataset (similar to Imagenet but for biomedical images).
Motivation
There is a clear need for biomedical image foundation models and large scale biomedical datasets that are easily streamable. This would be an excellent tool for the biomedical community.
Your contribution
MedImg can be found here.
The text was updated successfully, but these errors were encountered: