Add JiT Compilation to PCRE2 #449
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
apaniukov
changed the title
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
matchandsubstitutemethods ofPCRE2WrapperBenchmark results (i9-10980XE):
Xenova/gpt-4o:
Before:
Sync: OV: 1041.573 FPS, HF: 1831.254 FPS, OV/HF: 0.5687758075194422
Async: OV: 6873.116 FPS, HF: 1831.254 FPS, OV/HF: 3.753229524742228
After:
Sync: OV: 1828.426 FPS, HF: 1799.136 FPS, OV/HF: 1.0162797516004303
Async: OV: 6276.791 FPS, HF: 1799.136 FPS, OV/HF: 3.4887804039175005
BAAI/bge-reranker-v2-m3:
Before:
Sync: OV: 860.586 FPS, HF: 1503.576 FPS, OV/HF: 0.5723594732195535
Async: OV: 5459.165 FPS, HF: 1503.576 FPS, OV/HF: 3.6307875921539288
After:
Sync: OV: 1829.828 FPS, HF: 1561.229 FPS, OV/HF: 1.1720434745361927
Async: OV: 6909.142 FPS, HF: 1561.229 FPS, OV/HF: 4.425451319526877
google/flan-t5-xxl:
Before:
Sync: OV: 1015.991 FPS, HF: 1742.299 FPS, OV/HF: 0.5831325036213919
Async: OV: 6009.998 FPS, HF: 1742.299 FPS, OV/HF: 3.4494645037061304
After:
Sync: OV: 2003.620 FPS, HF: 1648.930 FPS, OV/HF: 1.2151027742685914
Async: OV: 6955.370 FPS, HF: 1648.930 FPS, OV/HF: 4.218110800753291
bert-base-uncased:
Before:
Sync: OV: 966.191 FPS, HF: 1796.871 FPS, OV/HF: 0.537707686934503
Async: OV: 5802.693 FPS, HF: 1796.871 FPS, OV/HF: 3.229332893522078
After:
Sync: OV: 1798.308 FPS, HF: 1769.413 FPS, OV/HF: 1.016330446103731
Async: OV: 6848.318 FPS, HF: 1769.413 FPS, OV/HF: 3.8703909704550936
Remove pointer from
UnigramTokenizerImpl