Skip to content

Commit e8d83c9

Browse files
authored
AC docs: added note about BF16 (openvinotoolkit#1289)
* AC docs: added note about BF16
1 parent 956f45e commit e8d83c9

File tree

2 files changed

+19
-0
lines changed

2 files changed

+19
-0
lines changed

tools/accuracy_checker/accuracy_checker/launcher/dlsdk_launcher_readme.md

+9
Original file line numberDiff line numberDiff line change
@@ -43,6 +43,15 @@ Additionally you can provide device specific parameters:
4343
* `gpu_extensions` (path to extension *.xml file with OpenCL kernel description for gpu).
4444
* `bitstream` for running on FPGA.
4545

46+
For setting device specific flags, you are able to use `-dc` or `--device_config` command line option. Device config should be represented as YML file with dictionary, where keys are plugin configuration keys and values are their values respectively.
47+
Each supported device has own set of supported configuration parameters which can be found on device page in [Inference Engine development guide](https://docs.openvinotoolkit.org/latest/_docs_IE_DG_supported_plugins_Supported_Devices.html)
48+
49+
**Note:** Since OpenVINO 2020.4 on platforms with native bfloat16 support models will be executed on this precision by default. For disabling this behaviour, you need to use device_config with following configuration:
50+
```yml
51+
ENFORCE_BF16: "NO"
52+
```
53+
Device config example can be found <a href="https://github.com/opencv/open_model_zoo/blob/develop/tools/accuracy_checker/sample/disable_bfloat16_device_config.yml">here</a>()
54+
4655
Beside that, you can launch model in `async_mode`, enable this option and optionally provide the number of infer requests (`num_requests`), which will be used in evaluation process. By default, if `num_requests` not provided or used value `AUTO`, automatic number request assignment for specific device will be performed
4756
For multi device configuration async mode used always. You can provide number requests for each device as part device specification: `MULTI:device_1(num_req_1),device_2(num_req_2)` or in `num_requests` config section (for this case comma-separated list of integer numbers or one value if number requests for all devices equal can be used).
4857

Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
# Device config example
2+
3+
# Contains device specific options which should be set to Inference Engine.
4+
# Set of supported keys can be found on device related page in Inference Engine Development guide.
5+
# Device config should be provided via -dc or --device_config commandline option.
6+
7+
# This config example shows how to disable bfloat16 optimizations for CPU.
8+
# Note: on platforms with native bfloat16 support, ENFORCE_BF16 parameter by default set as "YES",
9+
# for disabling this behavior you need to specify following configuration.
10+
ENFORCE_BF16: "NO"

0 commit comments

Comments
 (0)