Skip to content

Commit 6bcd18a

Browse files
AC docs: add note about segmentation_masks_source (openvinotoolkit#1243)
* AC: remove deprecated pipelined mode * AC docs: add mention abot changes in converters behavior * Revert "AC: remove deprecated pipelined mode" This reverts commit f93b429. * Update tools/accuracy_checker/accuracy_checker/annotation_converters/README.md Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com> * Update tools/accuracy_checker/accuracy_checker/annotation_converters/README.md Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com> Co-authored-by: Vladimir Dudnik <vladimir.dudnik@intel.com>
1 parent 16c24e5 commit 6bcd18a

File tree

3 files changed

+7
-2
lines changed

3 files changed

+7
-2
lines changed

tools/accuracy_checker/README.md

+1
Original file line numberDiff line numberDiff line change
@@ -172,6 +172,7 @@ And optionally:
172172
- `preprocessing`: list of preprocessing steps applied to input data. If you want calculated metrics to match reported, you must reproduce preprocessing from canonical paper of your topology or ask topology author about required steps.
173173
- `postprocessing`: list of postprocessing steps.
174174
- `reader`: approach for data reading. Default reader is `opencv_imread`.
175+
- `segmentation_masks_source` - path to directory where gt masks for semantic segmentation task stored.
175176

176177
Also it must contain data related to annotation.
177178
You can convert annotation inplace using:

tools/accuracy_checker/accuracy_checker/annotation_converters/README.md

+2
Original file line numberDiff line numberDiff line change
@@ -86,6 +86,7 @@ Accuracy Checker supports following list of annotation converters and specific f
8686
* `images_dir` - path to directory with images related to devkit root (default JPEGImages).
8787
* `mask_dir` - path to directory with ground truth segmentation masks related to devkit root (default SegmentationClass).
8888
* `dataset_meta_file` - path path to json file with dataset meta (e.g. label_map, color_encoding).Optional, more details in [Customizing dataset meta](#customizing-dataset-meta) section.
89+
**Note: since OpenVINO 2020.4 converter behaviour changed. `data_source` parameter of dataset should contains directory for images only, if you have segmentation mask in separated location, please use `segmentation_masks_source` for specifying gt masks location.**
8990
* `mscoco_detection` - converts MS COCO dataset for object detection task to `DetectionAnnotation`.
9091
* `annotation_file` - path ot annotation file in json format.
9192
* `has_background` - allows convert dataset with/without adding background_label. Accepted values are True or False. (default is False).
@@ -198,6 +199,7 @@ Accuracy Checker supports following list of annotation converters and specific f
198199
* `image_postfix` - postfix part for mask file names (optional, default is `.png`).
199200
* `mask_loader` - the way how GT mask should be loaded. Supported methods: `pillow`, `opencv`, `nifti`, `numpy`, `scipy`.
200201
* `dataset_meta_file` - path to json file with prepared dataset meta info. It should contains `label_map` key with dictionary in format class_id: class_name and optionally `segmentation_colors` (if your dataset uses color encoding). Segmentation colors is a list of channel-wise values for each class. (e.g. if your dataset has 3 classes in BGR colors, segmentation colors for it will looks like: `[[255, 0, 0], [0, 255, 0], [0, 0, 255]]`). (Optional, you can provide self-created file as `dataset_meta` in your config).
202+
**Note: since OpenVINO 2020.4 converter behaviour changed. `data_source` parameter of dataset should contains directory for images only, if you have segmentation mask in separated location, please use `segmentation_masks_source` for specifying gt masks location.**
201203
* `camvid` - converts CamVid dataset format to `SegmentationAnnotation`.
202204
* `annotation_file` - file in txt format which contains list of validation pairs (`<path_to_image>` `<path_to_annotation>` separated by space)
203205
* `dataset_meta_file` - path path to json file with dataset meta (e.g. label_map, color_encoding).Optional, more details in [Customizing dataset meta](#customizing-dataset-meta) section.

tools/accuracy_checker/dataset_definitions.yml

+4-2
Original file line numberDiff line numberDiff line change
@@ -492,7 +492,8 @@ datasets:
492492
dataset_meta: vggfaces2.json
493493

494494
- name: semantic_segmentation_adas
495-
data_source: segmentation
495+
data_source: segmentation/images
496+
segmentation_masks_source: segmentation/mask_segmentation_adas
496497
annotation_conversion:
497498
converter: common_semantic_segmentation
498499
images_dir: segmentation/images
@@ -517,7 +518,8 @@ datasets:
517518
dst_width: 2048
518519

519520
- name: road_segmentation
520-
data_source: segmentation
521+
data_source: segmentation/images
522+
segmentation_masks_source: segmentation/mask_road_segmentation
521523
annotation_conversion:
522524
converter: common_semantic_segmentation
523525
images_dir: segmentation/images

0 commit comments

Comments
 (0)