fix stateful seq2seq model inference perfomance #5771
Job | Run time |
---|---|
28m 47s | |
33m 0s | |
21m 5s | |
36m 15s | |
10m 34s | |
17m 54s | |
1m 59s | |
1m 50s | |
22m 57s | |
41m 3s | |
3h 35m 24s |
Job | Run time |
---|---|
28m 47s | |
33m 0s | |
21m 5s | |
36m 15s | |
10m 34s | |
17m 54s | |
1m 59s | |
1m 50s | |
22m 57s | |
41m 3s | |
3h 35m 24s |