katielink commited on
Commit
0832418
·
1 Parent(s): dd2d6d3

Update README for how to download dataset

Browse files
Files changed (3) hide show
  1. README.md +12 -5
  2. configs/metadata.json +3 -2
  3. docs/README.md +12 -5
README.md CHANGED
@@ -32,9 +32,15 @@ The training data is from <https://warwick.ac.uk/fac/cross_fac/tia/data/hovernet
32
 
33
  The provided labelled data was partitioned, based on the original split, into training (27 tiles) and testing (14 tiles) datasets.
34
 
 
 
 
 
 
 
35
  ### Preprocessing
36
 
37
- After download the datasets, please run `scripts/prepare_patches.py` to prepare patches from tiles. Prepared patches are saved in `<your concep dataset path>`/Prepared. The implementation is referring to <https://github.com/vqdang/hover_net>. The command is like:
38
 
39
  ```
40
  python scripts/prepare_patches.py --root <your concep dataset path>
@@ -53,7 +59,7 @@ This model utilized a two-stage approach. The training was performed with the fo
53
 
54
  ### Memory Consumption Warning
55
 
56
- If you face memory issues with CacheDataset, you can either switch to a regular Dataset class or lower the caching rate `cache_rate` in the configurations within range $(0, 1)$ to minimize the System RAM requirements.
57
 
58
  ## Input
59
  Input: RGB images
@@ -99,16 +105,17 @@ In addition to the Pythonic APIs, a few command line interfaces (CLI) are provid
99
 
100
  For more details usage instructions, visit the [MONAI Bundle Configuration Page](https://docs.monai.io/en/latest/config_syntax.html).
101
 
102
- #### Execute training, the evaluation in the training were evaluated on patches:
 
103
 
104
  - Run first stage
105
  ```
106
- python -m monai.bundle run --config_file configs/train.json --stage 0
107
  ```
108
 
109
  - Run second stage
110
  ```
111
- python -m monai.bundle run --config_file configs/train.json --network_def#freeze_encoder False --stage 1
112
  ```
113
 
114
  #### Override the `train` config to execute multi-GPU training:
 
32
 
33
  The provided labelled data was partitioned, based on the original split, into training (27 tiles) and testing (14 tiles) datasets.
34
 
35
+ You can download the dataset by using this command:
36
+ ```
37
+ wget https://warwick.ac.uk/fac/cross_fac/tia/data/hovernet/consep_dataset.zip
38
+ unzip consep_dataset.zip
39
+ ```
40
+
41
  ### Preprocessing
42
 
43
+ After download the [datasets](https://warwick.ac.uk/fac/cross_fac/tia/data/hovernet/consep_dataset.zip), please run `scripts/prepare_patches.py` to prepare patches from tiles. Prepared patches are saved in `<your concep dataset path>`/Prepared. The implementation is referring to <https://github.com/vqdang/hover_net>. The command is like:
44
 
45
  ```
46
  python scripts/prepare_patches.py --root <your concep dataset path>
 
59
 
60
  ### Memory Consumption Warning
61
 
62
+ If you face memory issues with CacheDataset, you can either switch to a regular Dataset class or lower the caching rate `cache_rate` in the configurations within range [0, 1] to minimize the System RAM requirements.
63
 
64
  ## Input
65
  Input: RGB images
 
105
 
106
  For more details usage instructions, visit the [MONAI Bundle Configuration Page](https://docs.monai.io/en/latest/config_syntax.html).
107
 
108
+ #### Execute training, the evaluation during the training were evaluated on patches:
109
+ Please note that if the default dataset path is not modified with the actual path in the bundle config files, you can also override it by using `--dataset_dir`:
110
 
111
  - Run first stage
112
  ```
113
+ python -m monai.bundle run --config_file configs/train.json --stage 0 --dataset_dir <actual dataset path>
114
  ```
115
 
116
  - Run second stage
117
  ```
118
+ python -m monai.bundle run --config_file configs/train.json --network_def#freeze_encoder False --stage 1 --dataset_dir <actual dataset path>
119
  ```
120
 
121
  #### Override the `train` config to execute multi-GPU training:
configs/metadata.json CHANGED
@@ -1,7 +1,8 @@
1
  {
2
  "schema": "https://github.com/Project-MONAI/MONAI-extra-test-data/releases/download/0.8.1/meta_schema_hovernet_20221124.json",
3
- "version": "0.1.9",
4
  "changelog": {
 
5
  "0.1.9": "add RAM warning",
6
  "0.1.8": "Update README for pretrained weights and save metrics in evaluate",
7
  "0.1.7": "Update README Formatting",
@@ -13,7 +14,7 @@
13
  "0.1.1": "update to use monai 1.1.0",
14
  "0.1.0": "complete the model package"
15
  },
16
- "monai_version": "1.2.0rc4",
17
  "pytorch_version": "1.13.1",
18
  "numpy_version": "1.22.2",
19
  "optional_packages_version": {
 
1
  {
2
  "schema": "https://github.com/Project-MONAI/MONAI-extra-test-data/releases/download/0.8.1/meta_schema_hovernet_20221124.json",
3
+ "version": "0.2.0",
4
  "changelog": {
5
+ "0.2.0": "Update README for how to download dataset",
6
  "0.1.9": "add RAM warning",
7
  "0.1.8": "Update README for pretrained weights and save metrics in evaluate",
8
  "0.1.7": "Update README Formatting",
 
14
  "0.1.1": "update to use monai 1.1.0",
15
  "0.1.0": "complete the model package"
16
  },
17
+ "monai_version": "1.2.0rc6",
18
  "pytorch_version": "1.13.1",
19
  "numpy_version": "1.22.2",
20
  "optional_packages_version": {
docs/README.md CHANGED
@@ -25,9 +25,15 @@ The training data is from <https://warwick.ac.uk/fac/cross_fac/tia/data/hovernet
25
 
26
  The provided labelled data was partitioned, based on the original split, into training (27 tiles) and testing (14 tiles) datasets.
27
 
 
 
 
 
 
 
28
  ### Preprocessing
29
 
30
- After download the datasets, please run `scripts/prepare_patches.py` to prepare patches from tiles. Prepared patches are saved in `<your concep dataset path>`/Prepared. The implementation is referring to <https://github.com/vqdang/hover_net>. The command is like:
31
 
32
  ```
33
  python scripts/prepare_patches.py --root <your concep dataset path>
@@ -46,7 +52,7 @@ This model utilized a two-stage approach. The training was performed with the fo
46
 
47
  ### Memory Consumption Warning
48
 
49
- If you face memory issues with CacheDataset, you can either switch to a regular Dataset class or lower the caching rate `cache_rate` in the configurations within range $(0, 1)$ to minimize the System RAM requirements.
50
 
51
  ## Input
52
  Input: RGB images
@@ -92,16 +98,17 @@ In addition to the Pythonic APIs, a few command line interfaces (CLI) are provid
92
 
93
  For more details usage instructions, visit the [MONAI Bundle Configuration Page](https://docs.monai.io/en/latest/config_syntax.html).
94
 
95
- #### Execute training, the evaluation in the training were evaluated on patches:
 
96
 
97
  - Run first stage
98
  ```
99
- python -m monai.bundle run --config_file configs/train.json --stage 0
100
  ```
101
 
102
  - Run second stage
103
  ```
104
- python -m monai.bundle run --config_file configs/train.json --network_def#freeze_encoder False --stage 1
105
  ```
106
 
107
  #### Override the `train` config to execute multi-GPU training:
 
25
 
26
  The provided labelled data was partitioned, based on the original split, into training (27 tiles) and testing (14 tiles) datasets.
27
 
28
+ You can download the dataset by using this command:
29
+ ```
30
+ wget https://warwick.ac.uk/fac/cross_fac/tia/data/hovernet/consep_dataset.zip
31
+ unzip consep_dataset.zip
32
+ ```
33
+
34
  ### Preprocessing
35
 
36
+ After download the [datasets](https://warwick.ac.uk/fac/cross_fac/tia/data/hovernet/consep_dataset.zip), please run `scripts/prepare_patches.py` to prepare patches from tiles. Prepared patches are saved in `<your concep dataset path>`/Prepared. The implementation is referring to <https://github.com/vqdang/hover_net>. The command is like:
37
 
38
  ```
39
  python scripts/prepare_patches.py --root <your concep dataset path>
 
52
 
53
  ### Memory Consumption Warning
54
 
55
+ If you face memory issues with CacheDataset, you can either switch to a regular Dataset class or lower the caching rate `cache_rate` in the configurations within range [0, 1] to minimize the System RAM requirements.
56
 
57
  ## Input
58
  Input: RGB images
 
98
 
99
  For more details usage instructions, visit the [MONAI Bundle Configuration Page](https://docs.monai.io/en/latest/config_syntax.html).
100
 
101
+ #### Execute training, the evaluation during the training were evaluated on patches:
102
+ Please note that if the default dataset path is not modified with the actual path in the bundle config files, you can also override it by using `--dataset_dir`:
103
 
104
  - Run first stage
105
  ```
106
+ python -m monai.bundle run --config_file configs/train.json --stage 0 --dataset_dir <actual dataset path>
107
  ```
108
 
109
  - Run second stage
110
  ```
111
+ python -m monai.bundle run --config_file configs/train.json --network_def#freeze_encoder False --stage 1 --dataset_dir <actual dataset path>
112
  ```
113
 
114
  #### Override the `train` config to execute multi-GPU training: