File tree 2 files changed +2
-2
lines changed
text_generation/causal_lm/cpp
2 files changed +2
-2
lines changed Original file line number Diff line number Diff line change @@ -47,7 +47,7 @@ The `--upgrade-strategy eager` option is needed to ensure `optimum-intel` is upg
47
47
``` sh
48
48
source < INSTALL_DIR> /setupvars.sh
49
49
python -m pip install --upgrade-strategy eager " optimum[openvino]>=1.14" -r ../../../llm_bench/python/requirements.txt ../../../thirdparty/openvino_contrib/modules/custom_operations/[transformers] --extra-index-url https://download.pytorch.org/whl/cpu
50
- python ../../../llm_bench/python/convert.py --model_id meta-llama/Llama-2-7b-hf --output_dir ./Llama-2-7b-hf/ --stateful
50
+ python ../../../llm_bench/python/convert.py --model_id meta-llama/Llama-2-7b-hf --output_dir ./Llama-2-7b-hf/ --save_orig -- stateful
51
51
python ./convert_tokenizers.py ./Llama-2-7b-hf/
52
52
```
53
53
Original file line number Diff line number Diff line change @@ -17,7 +17,7 @@ curl https://storage.openvinotoolkit.org/repositories/openvino/packages/nightly/
17
17
sudo ./ov/install_dependencies/install_openvino_dependencies.sh
18
18
19
19
source ./ov/setupvars.sh
20
- python -m pip install --upgrade-strategy eager " optimum[openvino]>=1.14" -r ../../../llm_bench/python/requirements.txt ../../../thirdparty/openvino_contrib/modules/custom_operations/[transformers] --extra-index-url https://download.pytorch.org/whl/cpu && python ../../../llm_bench/python/convert.py --model_id openlm-research/open_llama_3b_v2 --output_dir ./open_llama_3b_v2/ --stateful &
20
+ python -m pip install --upgrade-strategy eager " optimum[openvino]>=1.14" -r ../../../llm_bench/python/requirements.txt ../../../thirdparty/openvino_contrib/modules/custom_operations/[transformers] --extra-index-url https://download.pytorch.org/whl/cpu && python ../../../llm_bench/python/convert.py --model_id openlm-research/open_llama_3b_v2 --output_dir ./open_llama_3b_v2/ --save_orig -- stateful &
21
21
cmake -DCMAKE_BUILD_TYPE=Release -S ./ -B ./build/
22
22
cmake --build ./build/ --config Release -j
23
23
wait
You can’t perform that action at this time.
0 commit comments