-
Notifications
You must be signed in to change notification settings - Fork 81
Demo minimum requirement
Yipeng Hu edited this page Jul 8, 2020
·
17 revisions
- Each demo will have an independent folder directly under the 'Demos';
- Name the folder as
[loader-type]_[image-modality]_[organ-disease]_[optional:brief-remark]
, e.g.unpaired_ultrasound_prostate
orgrouped_mr_brain_logitudinal
; - For simplicity and ease to convert to notebooks later, avoid sub-folders (other than those specified below) and separate files for additional functions/classes;
- Experiment using cross-validation or random splitting is NOT encouraged, unless the purpose of the demo is to demonstrate how to design experiments.
- Each demo should have a 'demo_data.py' script to automatically download demo data;
- Data should be downloaded under the demo folder named
dataset
; - Data should be hosted in a reliable and efficient (not stored in this repo please) online storage, Kaggle, GitHub and Zendoo are all options for non-login access (avoid google drive for known accessibility issues);
- Relevant dataset folder structure to utilise the supported loaders can be either pre-arranged in data source or scripted after downloading; Avoid slow and large data set download.
- Each demo should have a 'demo_train.py' script;
- This is accompanied by a config yaml file in the same folder - please use the same folder name for the config file.
- Each demo should have a 'demo_predict.py' script;
- A pre-trained model must be available for downloading, e.g. the same as data (not stored in this repo please);
- The pre-trained model, e.g. ckpt file, should also be downloaded under
dataset
folder; - Results: Provide at least one piece of numerical metric (Dice, distance error, etc) and one piece of visualisation to show the efficacy of the registration (optimum performance is not required here).
The markdown file should contain the following sections:
- [Demo name] - Use the first-level subheading with # and all the following are using the second-level subheadings with ##;
- [Author] Author name and email (You can opt to be anonymous by using DeepReg Core Development Team);
- [Instruction] A step-by-step instruction how the demo can be run - preferably using the demo folder as working directory;
- [Application] Briefly describe the clinical application and the need for registration;
- [Data] Acknowledge data source.
- [Tested DeepReg Version] Demos do not need to be unit-tested. Record the version # of DeepReg that the demo has been tested.
- Please restrict using external libraries or anything unsupported by Colab or Azure;
- See general Contribution Guide.
tables: for google docs --> markdown, use tablesgenerator.org
formatting: for google docs --> markdown, use stackedit