Skip to content

Commit 530c08b

Browse files
authored
Update Readme
1 parent c89256f commit 530c08b

File tree

1 file changed

+5
-4
lines changed

1 file changed

+5
-4
lines changed

llm_bench/python/README.md

+5-4
Original file line numberDiff line numberDiff line change
@@ -100,20 +100,21 @@ python ./benchmark.py -h # for more information
100100
```
101101

102102
#### Benchmarking the Original PyTorch Model:
103-
To benchmark the original PyTorch model, first download the model locally and then run benchmark with `-f pytorch`
103+
To benchmark the original PyTorch model, first download the model locally and then run benchmark by specifying PyTorch as the framework with parameter `-f pt`
104104

105105
```bash
106106
# Download PyTorch Model
107107
huggingface-cli download meta-llama/Llama-2-7b-chat-hf --local-dir models/llama-2-7b-chat/pytorch
108-
# Benchmark PyTorch Model
109-
python benchmark.py -m models/llama-2-7b-chat/pytorch -n 2 -f pytorch
108+
# Benchmark with PyTorch Framework
109+
python benchmark.py -m models/llama-2-7b-chat/pytorch -n 2 -f pt
110110
```
111111

112112
> **Note:** If needed, You can install a specific OpenVINO version using pip:
113113
> ``` bash
114114
> # e.g.
115115
> pip install openvino==2024.4.0
116-
> # Optional, install the latest openvino_nightly if needed
116+
> # Optional, install the openvino nightly package if needed.
117+
> # OpenVINO nightly is pre-release software and has not undergone full release validation or qualification.
117118
> pip uninstall openvino
118119
> pip install --upgrade --pre openvino openvino-tokenizers --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly
119120
> ```

0 commit comments

Comments
 (0)