api_tokens.yml models/**
-
Notifications
You must be signed in to change notification settings - Fork 0
This repository is what I use to Build and Deploy the docker images to run my local Homelab LLM Inference. It builds containers with the necessary dependencies, pushes them to a self hosted Gitlab container registry, and starts my docker compose project to run the containers. Its built using Exllamav2 and TabbyAPI
davidallada/llm-repo
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
This repository is what I use to Build and Deploy the docker images to run my local Homelab LLM Inference. It builds containers with the necessary dependencies, pushes them to a self hosted Gitlab container registry, and starts my docker compose project to run the containers. Its built using Exllamav2 and TabbyAPI
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published