Skip to content

Commit 7c1d38b

Browse files
authored
Add speculative decoding example to OpenVINO quantized generation notebook (#635)
* Add assisted generation example to notebook * Bug fixes * Add acceptance rate measurement * Fix explanation of AR formula * Fix norm AR calc to ignore last window * Minor fixes
1 parent a48e0ca commit 7c1d38b

File tree

1 file changed

+389
-17
lines changed

1 file changed

+389
-17
lines changed

0 commit comments

Comments
 (0)