[llm bench]: add infer latency for genai (#1397) #5
Job | Run time |
---|---|
18m 12s | |
1s | |
17m 17s | |
26m 5s | |
1s | |
1s | |
1s | |
1s | |
14m 34s | |
1s | |
1s | |
1s | |
1s | |
1s | |
18m 52s | |
1s | |
26m 36s | |
1s | |
1s | |
1s | |
1s | |
2h 1m 51s |
Job | Run time |
---|---|
18m 12s | |
1s | |
17m 17s | |
26m 5s | |
1s | |
1s | |
1s | |
1s | |
14m 34s | |
1s | |
1s | |
1s | |
1s | |
1s | |
18m 52s | |
1s | |
26m 36s | |
1s | |
1s | |
1s | |
1s | |
2h 1m 51s |