多模型降级配置问题:降级未生效 #1907
Unanswered
ningmengweibazhahei
asked this question in
Q&A
多模型降级配置问题:降级未生效
#1907
Replies: 1 comment 2 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
higress版本:2.0.7,集群部署





1、我配置了两个 AI服务,如下:
2、AI路由配置未配置降级策略,请求正确的 deepseek-r1-gray / deepseek-r1-prod,如下:
3、将 deepseek-r1-gray 服务的秘钥改成错误的,如下:
4、AI路由开启降级配置,访问 deepseek-r1-gray 失败后,降级到 deepseek-r1-prod,配置如下:
5、请求网关服务,降级未成功
对应的yaml配置如下:


1、路由配置 configMap:ai-route-test-1
2、ingress 配置如下:
ai-route-test-1.internal
ai-route-test-1.fallback.internal

3、higress-config 如下:

按理 deepseek-r1-gray 请求失败后,应该降级到 deepseek-r1-prod 服务,但返回了 403 错误,辛苦帮忙看下是哪里配置的不对,感谢~
Beta Was this translation helpful? Give feedback.
All reactions