Skip to content

align rt_info int8 models compressed by default and via config#1130

Merged
AlexKoff88 merged 1 commit intohuggingface:mainfrom eaidova:ea/enable_kv_cache_compression_if_default_compressedJan 29, 2025

Commits

Commits on Jan 28, 2025