Skip to content

Commit 9bda579

Browse files
committed
Add --save_orig
1 parent b459919 commit 9bda579

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

text_generation/causal_lm/cpp/README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -47,7 +47,7 @@ The `--upgrade-strategy eager` option is needed to ensure `optimum-intel` is upg
4747
```sh
4848
source <INSTALL_DIR>/setupvars.sh
4949
python -m pip install --upgrade-strategy eager "optimum[openvino]>=1.14" -r ../../../llm_bench/python/requirements.txt ../../../thirdparty/openvino_contrib/modules/custom_operations/[transformers] --extra-index-url https://download.pytorch.org/whl/cpu
50-
python ../../../llm_bench/python/convert.py --model_id meta-llama/Llama-2-7b-hf --output_dir ./Llama-2-7b-hf/ --stateful
50+
python ../../../llm_bench/python/convert.py --model_id meta-llama/Llama-2-7b-hf --output_dir ./Llama-2-7b-hf/ --save_orig --stateful
5151
python ./convert_tokenizers.py ./Llama-2-7b-hf/
5252
```
5353

text_generation/causal_lm/cpp/set_up_and_run.sh

+1-1
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ curl https://storage.openvinotoolkit.org/repositories/openvino/packages/nightly/
1717
sudo ./ov/install_dependencies/install_openvino_dependencies.sh
1818

1919
source ./ov/setupvars.sh
20-
python -m pip install --upgrade-strategy eager "optimum[openvino]>=1.14" -r ../../../llm_bench/python/requirements.txt ../../../thirdparty/openvino_contrib/modules/custom_operations/[transformers] --extra-index-url https://download.pytorch.org/whl/cpu && python ../../../llm_bench/python/convert.py --model_id openlm-research/open_llama_3b_v2 --output_dir ./open_llama_3b_v2/ --stateful &
20+
python -m pip install --upgrade-strategy eager "optimum[openvino]>=1.14" -r ../../../llm_bench/python/requirements.txt ../../../thirdparty/openvino_contrib/modules/custom_operations/[transformers] --extra-index-url https://download.pytorch.org/whl/cpu && python ../../../llm_bench/python/convert.py --model_id openlm-research/open_llama_3b_v2 --output_dir ./open_llama_3b_v2/ --save_orig --stateful &
2121
cmake -DCMAKE_BUILD_TYPE=Release -S ./ -B ./build/
2222
cmake --build ./build/ --config Release -j
2323
wait

0 commit comments

Comments
 (0)