Files

.github
cmake
llm_bench
samples
- cpp
  - beam_search_causal_lm
  - benchmark_genai
  - chat_sample
  - continuous_batching_accuracy
  - continuous_batching_benchmark
    - CMakeLists.txt
    - continuous_batching_benchmark.cpp
  - greedy_causal_lm
  - lora_greedy_causal_lm
  - multinomial_causal_lm
  - prompt_lookup_decoding_lm
  - speculative_decoding_lm
  - stable_diffusion
  - visual_language_chat
  - whisper_speech_recognition
- python
- CMakeLists.txt
- requirements.txt
src
tests
thirdparty
tools
.clang-format
.gitignore
.gitmodules
CMakeLists.txt
Jenkinsfile
LICENSE
README.md
SECURITY.md
bandit.yml
pyproject.toml
requirements-build.txt
third-party-programs.txt

continuous_batching_benchmark

and

Token eviction (openvinotoolkit#757 )

Sep 27, 2024

2ed9889 · Sep 27, 2024

Name		Name	Last commit message	Last commit date
parent directory ..
CMakeLists.txt		CMakeLists.txt	Allow to build GenAI with OpenVINO via extra modules	Aug 2, 2024
continuous_batching_benchmark.cpp		continuous_batching_benchmark.cpp	Token eviction (openvinotoolkit#757 )	Sep 27, 2024