Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Function Calling Filter Pipeline erroring out #435

Open
shadowdao opened this issue Feb 20, 2025 · 2 comments
Open

Function Calling Filter Pipeline erroring out #435

shadowdao opened this issue Feb 20, 2025 · 2 comments

Comments

@shadowdao
Copy link

The Function Calling Filter Pipeline have been erroring in the "inlet" portion. I have been documenting in the Discord troubleshooting section.

Some examples of the logs that I had been receiving:

`Connection error: Object of type ModelModel is not JSON serializable

ERROR [open_webui.routers.tasks] Error generating chat completion: (500, 'list index out of range')
Connection error: 500 Server Error: Internal Server Error for url: http://pipelines:9099/test-pipeline/filter/inlet
INFO: 192.168.1.1:0 - "POST /api/v1/tasks/auto/completions HTTP/1.1" 500 Internal Server Error`

As a part of the troubleshooting process, I created a single pipeline that had the functionality of calling functions. I initially used the Function Calling Blueprint, and I got the error again.

I then started pulling parts from within the Blueprint to isolate the issue, and I found that the problem comes from how the Params are passed to the call_function part of the code.

I plan to submit a PR with the fix for this in the coming days.

@michae1michae1
Copy link

Getting the same issue - so your solution is to avoid importing the blueprint and sort of setting up what is in the blueprint into your pipeline with the params in one file?

Is that correct? - looking forward to your feedback / PR with the fix

@shadowdao
Copy link
Author

That's what I did for testing. I have a test piece in place, but where I kept running into issues was how the params were getting passed back from the first AI call. I have a version that works using Claude 3.5, but I need to do more testing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants