Skip to content
causal_lm_cpp

Prefix caching for sequences with embeddings. #9119

Sign in to view logs

Prefix caching for sequences with embeddings.

Prefix caching for sequences with embeddings. #9119

Re-run triggered March 5, 2025 07:02
@ilya-lavrenovilya-lavrenov
#1841
popovaan:prefix_caching_with_embeddings
Status Success
Total duration 15m 10s
Artifacts –

causal_lm_cpp.yml

on: pull_request
cpp-greedy_causal_lm-windows
34m 1s
cpp-Phi-1_5
7m 36s
cpp-greedy_causal_lm-redpajama-3b-chat
12m 41s
cpp-chat_sample-ubuntu
15m 36s
visual_language_chat_sample-ubuntu-minicpm_v2_6
8m 22s
visual_language_chat_sample-ubuntu-llava_1_5  /  visual_language_chat_sample-ubuntu-llava
11m 13s
visual_language_chat_sample-ubuntu-llava_next  /  visual_language_chat_sample-ubuntu-llava
12m 56s
visual_language_chat_sample-ubuntu-internvl2
11m 1s
cpp-continuous-batching-ubuntu
13m 1s
cpp-continuous-batching-windows
31m 0s
cpp-continuous-batching-macos
21m 44s
benchmark_genai-ubuntu
14m 50s
visual_language_chat_sample-ubuntu-qwen2vl
10m 37s
ci/gha_overall_status_causal_lm
0s