feat: Add LM Studio compatibility #1302
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Added LM Studio as a new plugin, now it can be used with Fabric. - Updated the plugin registry with the new plugin name - Updated the configuration with the required base url
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What this Pull Request (PR) does
This PR adds LM Studio compatibility. Now this can be used side by side with OpenAI no need for changing URLs in the .env file to make it work
Related issues
closes #[928]
A lot of credit goes to @sosacrazy126 as this is based on his solution.
How to test
git clone https://github.com/verebes1/fabric.gitcd fabricgo installfabric --setupand setup your local url for LM Studio alternatively you can also add the url yourself to your .env file to fabric's settingsLM_STUDIO_API_BASE_URL=http://localhost:1234/v1fabric --listmodelsecho "Tell me a story about golang?" | fabric -sp ai -m YOUR_MODEL_LOADED_IN_LM_STUDIOScreenshots