Lately Claude models (specifically Opus and Sonnet 3.5) return throttle exceptions even if limits have not been exceeded; therefore I modified the lambda function so that if it encounters such an error, it will cycle through 4 different models (defined as environment variables) so as to generate an answer even if it is with a different model.#45
Open
amaynez wants to merge 3 commits intoaws-samples:mainfrom amaynez:main
+59-304
Commits
Commits on Sep 3, 2024
- committed
- committed