You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When using the fallback capability, it is similar to the situation in #1901 , where model mapping cannot be set.
The configuration method also needs to be modified in a similar way.
Can be changed to the following configuration:
apiVersion: extensions.higress.io/v1alpha1kind: WasmPluginmetadata:
name: model-mapper.internalnamespace: higress-systemspec:
defaultConfigDisable: truefailStrategy: FAIL_OPENmatchRules:
- config:
modelMapping:
'gpt-4-*': "qwen-max"'gpt-4o': "qwen-vl-plus"'*': "qwen-turbo"configDisable: false# This configuration takes effect when the following ingress and service match simultaneously.ingress:
- ai-route-dashscope.internalservice:
- llm-dashscope.internal.dns
- config:
modelMapping:
'gpt-4-*': "qwen-plus"'*': "qwen-long"configDisable: false# This configuration takes effect when the following ingress and service match simultaneously.ingress:
# When fallback is triggered, it will go through this ingress.
- ai-route-dashscope.fallback.internalservice:
- llm-dashscope.internal.dns phase: AUTHNpriority: 800url: oci://higress-registry.cn-hangzhou.cr.aliyuncs.com/plugins/model-mapper:1.0.0
The text was updated successfully, but these errors were encountered:
When using the fallback capability, it is similar to the situation in #1901 , where model mapping cannot be set.
The configuration method also needs to be modified in a similar way.
Can be changed to the following configuration:
The text was updated successfully, but these errors were encountered: