Skip to content

Commit dab4a78

Browse files
committed
add use_cache param when init generation config
Signed-off-by: jiqing-feng <jiqing.feng@intel.com>
1 parent f094cad commit dab4a78

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

optimum/intel/ipex/modeling_base.py

+1
Original file line numberDiff line numberDiff line change
@@ -298,6 +298,7 @@ def forward(
298298
def _prepare_generation_config(
299299
self, generation_config: Optional[GenerationConfig], **kwargs: Dict
300300
) -> Tuple[GenerationConfig, Dict]:
301+
kwargs["use_cache"] = self.use_cache
301302
generation_config, model_kwargs = super()._prepare_generation_config(generation_config, **kwargs)
302303
generation_method = generation_config.get_generation_mode().value
303304
if self.compiled and generation_config.cache_implementation != "ipex_paged" and self._supports_static_cache:

0 commit comments

Comments
 (0)