Skip to content

Commit e0392dc

Browse files
authored
[DOCS] Fixing code snippet in OV Tokenizers article for master (openvinotoolkit#26114)
Jira: 149945 Fixed mentioned issues in code snippets in OV Tokenizers article.
1 parent c328ded commit e0392dc

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

docs/articles_en/learn-openvino/llm_inference_guide/ov-tokenizers.rst

+3-3
Original file line numberDiff line numberDiff line change
@@ -236,8 +236,8 @@ Convert Tokenizers:
236236
237237
tokenizer_dir = Path("tokenizer/")
238238
core = Core()
239-
ov_tokenizer = core.read_model(tokenizer_dir / "openvino_tokenizer")
240-
ov_detokenizer = core.read_model(tokenizer_dir / "openvino_detokenizer")
239+
ov_tokenizer = core.read_model(tokenizer_dir / "openvino_tokenizer.xml")
240+
ov_detokenizer = core.read_model(tokenizer_dir / "openvino_detokenizer.xml")
241241
242242
tokenizer, detokenizer = core.compile_model(ov_tokenizer), core.compile_model(ov_detokenizer)
243243
@@ -278,7 +278,7 @@ You can find more information and code snippets in the `OpenVINO Tokenizers Note
278278

279279
.. code-block:: python
280280
281-
input numpy as np
281+
import numpy as np
282282
283283
text_input = ["Quick brown fox jumped"]
284284

0 commit comments

Comments
 (0)