You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
* Added support for OneDNN FusedBatchNormEx and FusedConV2D (openvinotoolkit#112)
* Added support for OneDNN FusedBatchNormEx and FusedConV2D
Co-authored-by: Cavus Mustafa <mustafa.cavus@intel.com>
* FusedDepthwiseConv2d and improved FusedConv2D support (openvinotoolkit#114)
* Upgradation of TensorFlow version to v2.5.0 (openvinotoolkit#111)
* added math_op to skip list for gpu
* changed tf build location in ci
* change abi1 tf links, add docker tf pip whls build patch
Co-authored-by: Suryaprakash Shanmugam <suryaprakash.shanmugam@intel.com>
* Lazy Fallback (Support for Dynamic Fallback) (openvinotoolkit#113)
* Initial implementation of dynamic fallback
* Error check fix for dynamic fallback
* Improved coverage for dynamic fallback
* dyn fb bugfix & dyn fb disabled by default
* Fixed python api typo
* Code cleanup in executable.cc
* tf 1.x support for dyn. fallback
* Fix for freezing inf. with dyn. fb. when interop is 1
* memory leak fixes (openvinotoolkit#110)
* OCM submodule updated for fused ops (openvinotoolkit#115)
* Updated code for some checks (openvinotoolkit#104)
* Update build_utils.py
* add suggested checks (openvinotoolkit#119)
* checks in py files
* added exception catching for assert statement
* fixed uninitialized variable issue (openvinotoolkit#120)
* doc update (openvinotoolkit#123)
* installing opencv during venv setup
* typo fix and removed opencv installation manually
* Adding azure pipelines using docker (openvinotoolkit#122)
* Removed shell as True with subprocess pipe (openvinotoolkit#127)
* Initial TROUBLESHOOTING.md and updates on ARCHITECTURE.md (openvinotoolkit#126)
* GUIDE document added, ARCHITECTURE updated for dyn. fb.
* Filename change: GUIDE.md to TROUBLESHOOTING.md
* AWS, Azure and Colab classification notebook added (openvinotoolkit#125)
* collab notebook added for object detection
* fixing path traversal issues (openvinotoolkit#129)
* Code changes for models support (openvinotoolkit#130)
* Added following op translations and changes:
* NonmaxsuppresionV3, FusedConv2d with BiasAdd LeakyRelu, FusedConv2d with BiasAdd Add Relu
* get_shape replaced with get_partial_shape where only rank is needed
* deassign cluster modifed for dynamic ops
* translation for fusedops with ELU added
* dynamic input condition handled for Fill op
* zero dim check updated
* Updated TopkV2 translation for zero dim inputs
* fix for execution errors and collab badge support added
* fix build error during tensorflow installation (openvinotoolkit#132)
* Fix for build error during tensorflow installation
Properly check cmake and gcc versions
Force re-install packages for them to take effect after every re-build
* OV2021.4 build support enabled (openvinotoolkit#131)
* Updated the code for OV2021.4
* OCM updated for OV2021_4
* Enabled OpenVINO 2021.4, but kept default build version as 2021.3 due to SetBlob issue
Co-authored-by: Suryaprakash Shanmugam <suryaprakash.shanmugam@intel.com>
* Fixed bug in FusedBatchNormEx translation (openvinotoolkit#134)
* Fix cmake and gcc version checks (openvinotoolkit#136)
* Fix cmake and gcc version checks
* review comments incorporated in colab notebooks
* Added Op translations and tests (openvinotoolkit#137)
* Added translation for Resize Nearest Neighbor, GatherNd and Round OP translations
* Added CropAndResize op and flip crop fix for CropAndResize
* Added Reverse, Reciprocal, BatchToSpaceND, SpaceToBatchND, and Elu
* Added TF Python tests for the above
* Handle corner case in TranslateBatchNDAndSpaceNDOp
* Add ops to gpu and myriad devices; update ocm
* Adjust tolerance precision for fusedMatMul
* Properly handle dynfallback flag; Print cluster summary
Co-authored-by: ck-intel <chandrakant.khandelwal@intel.com>
* Fetch and print OpenVINO version that OVTF was built against (openvinotoolkit#142)
* Fetch and print OpenVINO version that OVTF was built against
* Add import openvino_tensorflow to TF tests using find and replace instead of using patch (openvinotoolkit#141)
* Enable cluster fallback through static initializers; Change default summary log info (openvinotoolkit#146)
* Enable cluster fallback through static initializers; Change default summary log info
* OpenVINO 2021 4 Upgrade Docs, CI, and Tests (openvinotoolkit#145)
* Update OV version in docs, pipelines, and code
* Update UT lists; fix OpenVINO 2021.4 download links in Dockerfiles
* Fix ci random failures (openvinotoolkit#148)
* Documentation review changes
* Remove Code format check from Ubuntu-20 as clang-format-3.9 is not available in it
* Installation table updated with MAC OS entries (openvinotoolkit#153)
* Enable macOS Support (openvinotoolkit#133)
* Initial commit for macOS
* Merge commit '03379a2b92e0e11e94c6e6f709e3ee7770723f1a'
* add TF 2 dylib var
* fix virtualenv creation in py3
* Changing default OpenVINO version 2021.3 due to SetBlob issue
* identify python minor version for load_venv
* Adding the mac azure pipelines for ovtf project
* Updating mac yml files
* Fix CPU plugin issue, Fix unit test spawn issue for macOS
* add mkldnn lib for release and debug build types
* Update mac azure pipeline
* Update OV version in docs, pipelines, and code
* Update darwin tests list
* Rebased on pre_gold_dev; Remove build errors; Update tests list
* Enable VPU in OpenVINO, make on all cores
* Update ABI0 based build pipeline on macOS
* Add rpath to myriadPlugin and include myriad unit tests
* Add myriad UT list files
* Run myriad TF UT directly through tf_unittest_runner due to mutex error
* Use -march=native only for Linux
Co-authored-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
Co-authored-by: bhadur <bhadur.a.sm@intel.com>
* Supporting backends (openvinotoolkit#152)
* GPU_FP16 changes (openvinotoolkit#149)
* Device name check for GPU FP16
Co-authored-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
* Export IR API is and related functionality is added (openvinotoolkit#150)
* Document text correction for export ir
* Fix TF1.x build failures that were due to Timestamp logic and dtype errors (openvinotoolkit#155)
* Conditional compilation for timestamp logic; Fix DType error in TF 1.x in ovtf_builder
* Models list updated (openvinotoolkit#151)
* Corrected link for NCF-1B model
* Devices name alignment in table
Co-authored-by: Chandrakant Khandelwal <chandrakant.khandelwal@intel.com>
* Fixed cmake flags issue and updated OV branch tags for previous released versions (openvinotoolkit#156)
* Upgrade OVTF Python Samples to TF 2.x (openvinotoolkit#135)
* added multi input support (image, video, camera)
* added python examples to cpu ci pipline
* removed tf 1.15.2 from req
* api changes to tf2.5
* Python Inference Example Detection stage update
* removed python samples in ci stages
* tested camera input
* Adding TF1x samples folder
* TF 1.x yolo v3 model implementation to TF 2.x
* added the pip packges to requirements
* added assertion for input_file
* added python sample to ci pipeline
* added matplotlib as requirement
* added TF1 python sample to ci pipeline
* added requirements.txt
* added --input arg help message
* removed matplotlib installation
* added requirements.txt to python TF2 stage
* removed pip packages for ovtf samples
* added python3.6 for TF1.x yolov3 conversion
* bug fix for TF1.x python sample on MYRIAD
* explicitly added the backends
* python version check
* installing python3.6
* saving the .h5 keras format for yolov3 darknet
* added TF2.x API inference on .h5 kears format
* added TF2.X APIs for inference with .h5 model
* rollback to tf.compat.v1 for loading the graph
* Renamed to TF_1_x and removed the unused files.
* updated the TF1.x folder name to TF_1_x
* removed filtering for listing ovtf backends
* removing unused files
* renaming output model
* removed data folder in TF_1_x , using common utils
* default model name change
* Updated help message
* removed python TF1 OD samples
* assigned 0 for camera input
* updated CI pipelines for python samples
* assigned 0 for camera input
* Unit tests update (openvinotoolkit#116)
* TF unit test updates for all the devices
* Add Explicit Padding to Conv2D.
* Update TF unit test cases for MAC OS
Co-authored-by: Peetha Veeramalai <preetha.veeramalai@intel.com>
* OVTF Mandarin documentation (openvinotoolkit#138)
* Updated OVTF Mandarin documentation
Co-authored-by: Chandrakant Khandelwal <chandrakant.khandelwal@intel.com>
* GPU core dump issue fixed (openvinotoolkit#159)
Co-authored-by: Mustafa Cavus <cavusmustafa@intel.com>
* Updated Mandarin readme documentation (openvinotoolkit#162)
* Samples README update and yolov3 anchors file addition (openvinotoolkit#157)
* added yolov3 anchors file
* added license and writing output detections
* changeed python default version to python3
* releasing memory after backends_len call
* check backend updated and removed MIT license
Co-authored-by: pratiksha123507 <pratikshax.bapusaheb.vanse@intel.com>
* Update documentation for BUILD.md, INSTALL.md, and add requirements.txt (openvinotoolkit#158)
* Add dependency install steps for Ubuntu and macOS
* Add Bazelisk optional step
* Upgrade OVTF version across files
* Add separate instruction for PIP installations and update docs
* Fix networkx version as 2.5.1 is common supported version for both Ubuntu 18.04 and 20.04
* Updated the installation commands in Interactive Table
* Change PIL minimum required version
* Added INSTALL.md link
* Updated the build dependencies steps
Co-authored-by: chandrakant khandelwal <chandrakant.khandelwal@intel.com>
Co-authored-by: Ritesh Rajore <ritesh.kumar.rajore@intel.com>
* Updated readme and license; Update interactive installation table (openvinotoolkit#163)
Co-authored-by: Suryaprakash Shanmugam <suryaprakash.shanmugam@intel.com>
* ManyLinux2014 Wheel Generation (openvinotoolkit#165)
* Add patch file for manylinux
* Update manylinux2014 Dockerfile
* Add python 3.9
* Update versions in main.js
* Dynamic fallback output fix (openvinotoolkit#166)
* Dynamic fallback output issue fixed
* Added INT8 quantization support (openvinotoolkit#144)
* Added Translations and Transposes needed for Int8 Quantization
* Added documentation for INT8 quantization support
* Added CPU device condition for Relu6 and Constant Folding pass
* Updated the CPU condition
* Removed default enabling of constant folding on CPU
Co-authored-by: chandrakant khandelwal <chandrakant.khandelwal@intel.com>
* Version number changes in docs, code, and pipelines (openvinotoolkit#169)
* updated MODELS.md (openvinotoolkit#167)
* Upgrade to OV 2021.4.1 version (openvinotoolkit#170)
* Code changes for OV 2021.4.1 upgrade
* Updated docs for 2021.4.1
* Add changes to ABI1 whl generation Dockerfile
Co-authored-by: Suryaprakash Shanmugam <suryaprakash.shanmugam@intel.com>
* Updated docs based on review comments (openvinotoolkit#171)
* Document updates for GPU_FP16
* Update TROUBLESHOOTING.md
* Additional document updates on GPU_FP16
* Update AWS_instructions.md
* Update Azure_instructions.md
* Installation table intro modified
Co-authored-by: Yamini Nimmagadda <yamini.nimmagadda@intel.com>
Co-authored-by: Cavus Mustafa <mustafa.cavus@intel.com>
Co-authored-by: Sai Jayanthi <sai.jayanthi@intel.com>
* TF version updated in colab notebooks & Update examples documentation (openvinotoolkit#168)
Co-authored-by: adisan3 <adityax.sanivarapu@intel.com>
* Update OCM submodule(openvinotoolkit#172)
* Export IR race condition issues are removed (openvinotoolkit#173)
* Pillow version update (openvinotoolkit#175)
* Updating readme for users using OVTF with CUDA capable GPUs (openvinotoolkit#177)
* Model doc files updated with new models (openvinotoolkit#178)
* Model doc files updated with 2 new models
* Added complete model support for Facenet and lm_1b
* Added warm-up inference run for samples (openvinotoolkit#179)
* Added warm-up for first inference
* Add Python3.9 Support for ABI1 Wheels (openvinotoolkit#176)
* Add support for Python 3.9 wheels in ABI1 builds
* Add python3.9-dev apt package
* Updated INT8 quantization documentation in MODELS.md (openvinotoolkit#181)
* Desciprtion for enabling oneDNN added to the README.md (openvinotoolkit#182)
* Updated MODELS_cn doc (openvinotoolkit#180)
* Update PyPi Documentation (openvinotoolkit#183)
* Updated models file (openvinotoolkit#186)
Co-authored-by: Chandrakant Khandelwal <chandrakant.khandelwal@intel.com>
* Update Mandarin Documentation and DevCloud Links(openvinotoolkit#185)
* Add updated Mandarin documentation
Co-authored-by: Suryaprakash Shanmugam <suryaprakash.shanmugam@intel.com>
* Update mandarin readme and models file (openvinotoolkit#187)
* Print TF version instead of git version (openvinotoolkit#188)
Co-authored-by: Yamini Nimmagadda <yamini.nimmagadda@intel.com>
Co-authored-by: Cavus Mustafa <mustafa.cavus@intel.com>
Co-authored-by: mohdansx <mohdx.ansari@intel.com>
Co-authored-by: Suryaprakash Shanmugam <suryaprakash.shanmugam@intel.com>
Co-authored-by: Sai Jayanthi <sai.jayanthi@intel.com>
Co-authored-by: adisan3 <adityax.sanivarapu@intel.com>
Co-authored-by: bhadur <bhadur.a.sm@intel.com>
Co-authored-by: Ambarish Das <ambarish.das@intel.com>
Co-authored-by: Surya Siddharth Pemmaraju <surya.siddharth.pemmaraju@intel.com>
Co-authored-by: pratiksha123507 <pratikshax.bapusaheb.vanse@intel.com>
Co-authored-by: Peetha Veeramalai <preetha.veeramalai@intel.com>
Co-authored-by: Mustafa Cavus <cavusmustafa@intel.com>
Co-authored-by: Ritesh Rajore <ritesh.kumar.rajore@intel.com>
# **OpenVINO™ integration with TensorFlow (Preview Release)**
7
+
# **OpenVINO™ integration with TensorFlow**
6
8
7
-
This repository contains the source code of **OpenVINO™ integration with TensorFlow**, a product that delivers [OpenVINO™](https://software.intel.com/content/www/us/en/develop/tools/openvino-toolkit.html)inline optimizations and runtime needed for an enhanced level of TensorFlow compatibility. It is designed for developers who want to get started with OpenVINO™ in their inferencing applications to enhance inferencing performance with minimal code modifications. **OpenVINO™ integration with TensorFlow** accelerates inference across many [AI models](https://github.com/openvinotoolkit/openvino_tensorflow/blob/master/docs/MODELS.md) on a variety of Intel<sup>®</sup> silicon such as:
9
+
This repository contains the source code of **OpenVINO™ integration with TensorFlow**, designed for TensorFlow* developers who want to get started with [OpenVINO™](https://software.intel.com/content/www/us/en/develop/tools/openvino-toolkit.html)in their inferencing applications. This product delivers [OpenVINO™](https://software.intel.com/content/www/us/en/develop/tools/openvino-toolkit.html) inline optimizations which enhance inferencing performance with minimal code modifications. **OpenVINO™ integration with TensorFlow** accelerates inference across many [AI models](docs/MODELS.md) on a variety of Intel<sup>®</sup> silicon such as:
8
10
- Intel<sup>®</sup> CPUs
9
11
- Intel<sup>®</sup> integrated GPUs
10
-
- Intel<sup>®</sup> Movidius™ Vision Processing Units - referred as VPU
11
-
- Intel<sup>®</sup> Vision Accelerator Design with 8 Intel Movidius™ MyriadX VPUs - referred as VAD-M or HDDL
12
+
- Intel<sup>®</sup> Movidius™ Vision Processing Units - referred to as VPU
13
+
- Intel<sup>®</sup> Vision Accelerator Design with 8 Intel Movidius™ MyriadX VPUs - referred to as VAD-M or HDDL
12
14
13
-
[Note: For maximum performance, efficiency, tooling customization, and hardware control, we recommend going beyond this component to adopt native OpenVINO™ APIs and its runtime.]
15
+
[Note: For maximum performance, efficiency, tooling customization, and hardware control, we recommend the developers to adopt native OpenVINO™ APIs and its runtime.]
14
16
15
17
## Installation
16
18
### Prerequisites
17
19
18
-
- Ubuntu 18.04, 20.04
19
-
- Python 3.6, 3.7, or 3.8
20
-
- TensorFlow v2.5.0
20
+
- Ubuntu 18.04, 20.04 or macOS 11.2.3
21
+
- Python* 3.6, 3.7, 3.8 or 3.9
22
+
- TensorFlow* v2.5.1
21
23
22
24
Check our [Interactive Installation Table](https://openvinotoolkit.github.io/openvino_tensorflow/) for a menu of installation options. The table will help you configure the installation process.
23
25
24
-
### Install **OpenVINO™ integration with TensorFlow** alongside PyPi TensorFlow
25
-
26
-
This **OpenVINO™ integration with TensorFlow** package comes with pre-built libraries of OpenVINO™ version 2021.3 meaning you don't have to install OpenVINO™ separately. This package supports:
26
+
The **OpenVINO™ integration with TensorFlow** package comes with pre-built libraries of OpenVINO™ version 2021.4.1. The users do not have to install OpenVINO™ separately. This package supports:
27
27
- Intel<sup>®</sup> CPUs
28
28
- Intel<sup>®</sup> integrated GPUs
29
29
- Intel<sup>®</sup> Movidius™ Vision Processing Units (VPUs)
30
30
31
31
32
-
pip3 install -U pip==21.0.1
33
-
pip3 install -U tensorflow==2.5.0
34
-
pip3 install openvino-tensorflow
32
+
pip3 install pip==21.0.1
33
+
pip3 install tensorflow==2.5.1
34
+
pip3 install -U openvino-tensorflow
35
35
36
36
37
-
If you want to leverage Intel® Vision Accelerator Design with Movidius™ (VAD-M) for inference, install [**OpenVINO™ integration with TensorFlow** alongside the Intel® Distribution of OpenVINO™ Toolkit](docs/BUILD.md#install-openvino-integration-with-tensorflow-alongside-the-intel-distribution-of-openvino-toolkit).
37
+
To leverage Intel® Vision Accelerator Design with Movidius™ (VAD-M) for inference, install [**OpenVINO™ integration with TensorFlow** alongside the Intel® Distribution of OpenVINO™ Toolkit](docs/INSTALL.md#12-install-openvino-integration-with-tensorflow-alongside-the-intel-distribution-of-openvino-toolkit).
38
38
39
-
For more details on other modes of installation, please refer to [BUILD.md](docs/BUILD.md)
39
+
For more details on installation please refer to [INSTALL.md](docs/INSTALL.md), and for build from source options please refer to [BUILD.md](docs/BUILD.md)
40
40
41
41
## Configuration
42
42
43
-
Once you've installed **OpenVINO™ integration with TensorFlow**, you can use TensorFlow to run inference using a trained model.
43
+
Once you've installed **OpenVINO™ integration with TensorFlow**, you can use TensorFlow* to run inference using a trained model.
44
+
45
+
For the best results, it is advised to enable [oneDNN Deep Neural Network Library (oneDNN)](https://github.com/oneapi-src/oneDNN) by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=1`.
44
46
45
47
To see if **OpenVINO™ integration with TensorFlow** is properly installed, run
46
48
@@ -49,27 +51,31 @@ To see if **OpenVINO™ integration with TensorFlow** is properly installed, run
49
51
50
52
This should produce an output like:
51
53
52
-
TensorFlow version: 2.5.0
53
-
OpenVINO integration with TensorFlow version: b'0.5.0'
54
-
OpenVINO version used for this build: b'2021.3'
55
-
TensorFlow version used for this build: v2.5.0
54
+
TensorFlow version: 2.5.1
55
+
OpenVINO integration with TensorFlow version: b'1.0.0'
56
+
OpenVINO version used for this build: b'2021.4.1'
57
+
TensorFlow version used for this build: v2.5.1
56
58
CXX11_ABI flag used for this build: 0
57
-
OpenVINO integration with TensorFlow built with Grappler: False
58
59
59
60
By default, Intel<sup>®</sup> CPU is used to run inference. However, you can change the default option to either Intel<sup>®</sup> integrated GPU or Intel<sup>®</sup> VPU for AI inferencing. Invoke the following function to change the hardware on which inferencing is done.
60
61
61
62
openvino_tensorflow.set_backend('<backend_name>')
62
63
63
-
Supported backends include 'CPU', 'GPU', 'MYRIAD', and 'VAD-M'.
64
+
Supported backends include 'CPU', 'GPU', 'GPU_FP16', 'MYRIAD', and 'VAD-M'.
64
65
65
66
To determine what processing units are available on your system for inference, use the following function:
66
67
67
68
openvino_tensorflow.list_backends()
68
-
For more API calls and environment variables, see [USAGE.md](https://github.com/openvinotoolkit/openvino_tensorflow/blob/master/docs/USAGE.md).
69
+
For more API calls and environment variables, see [USAGE.md](docs/USAGE.md).
70
+
71
+
[Note: If a CUDA capable device is present in the system then set the environment variable CUDA_VISIBLE_DEVICES to -1]
69
72
70
73
## Examples
71
74
72
-
To see what you can do with **OpenVINO™ integration with TensorFlow**, explore the demos located in the [examples](https://github.com/openvinotoolkit/openvino_tensorflow/tree/master/examples) directory.
75
+
To see what you can do with **OpenVINO™ integration with TensorFlow**, explore the demos located in the [examples](./examples) directory.
76
+
77
+
## Try it on Intel<sup>®</sup> DevCloud
78
+
Sample tutorials are also hosted on [Intel<sup>®</sup> DevCloud](https://software.intel.com/content/www/us/en/develop/tools/devcloud/edge/build/ovtfoverview.html). The demo applications are implemented using Jupyter Notebooks. You can interactively execute them on Intel<sup>®</sup> DevCloud nodes, compare the results of **OpenVINO™ integration with TensorFlow**, native TensorFlow and OpenVINO™.
73
79
74
80
## License
75
81
**OpenVINO™ integration with TensorFlow** is licensed under [Apache License Version 2.0](LICENSE).
@@ -88,3 +94,6 @@ We welcome community contributions to **OpenVINO™ integration with TensorFlow*
88
94
* Submit a [pull request](https://github.com/openvinotoolkit/openvino_tensorflow/pulls).
89
95
90
96
We will review your contribution as soon as possible. If any additional fixes or modifications are necessary, we will guide you and provide feedback. Before you make your contribution, make sure you can build **OpenVINO™ integration with TensorFlow** and run all the examples with your fix/patch. If you want to introduce a large feature, create test cases for your feature. Upon our verification of your pull request, we will merge it to the repository provided that the pull request has met the above mentioned requirements and proved acceptable.
97
+
98
+
---
99
+
\* Other names and brands may be claimed as the property of others.
0 commit comments