This document lists the release notes for the TensorFlow-Neuron package.
Date: 12/1/2019
- Fix race condition between model load and model unload when the process is killed
- Remove unnecessary GRPC calls when the process is killed
-
When compiling a large model, may encounter “terminate called after throwing an instance of 'std::bad_alloc'”. Solution: run compilation on c5.4xlarge instance type or larger.
-
The pip package
wrapt
may have a conflicting version in some installations. This is seen when this error occurs:
ERROR: Cannot uninstall 'wrapt'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.
to solve this, you can update wrapt to the newer version:
conda update wrapt
python3 -m pip install tensorflow-neuron
or
python3 -m pip install wrapt --ignore-installed
python3 -m pip install tensorflow-neuron
Date: 11/25/2019
This version is available only in released DLAMI v26.0. Please update to latest version.
The following models have successfully run on neuron-inferentia systems
- BERT_LARGE and BERT_BASE
- Transformer
- Resnet50 V1/V2
- Inception-V2/V3/V4