Code

Add openvino tokenizers directory#707

Code

Closed

echarlaix wants to merge 2 commits intomainhuggingface/optimum-intel:mainfrom ov-tokenizershuggingface/optimum-intel:ov-tokenizersCopy head branch name to clipboard

Commits

Commits on May 14, 2024

• Add openvino tokenizers

  echarlaix

  committed
  d38fce1

  Copy full SHA for d38fce1

Commits on May 16, 2024

• Merge branch 'main' into ov-tokenizers

  echarlaix

  committed
  ee56a02

  Copy full SHA for ee56a02