Ollama Ansible Collection

Overview

Use this Ansible Collection to provision Ollama on your system

Requirements

Ansible Version

This collection requires ansible from version 2.14.0 and above

Collections

This collection depends on the following collections:

• community.general: "*"
• containers.podman: "*"
• kubernetes.core: "*"

Roles

The collection includes a single role

• common - Common installations, not intended to be used directly
• nvidia - Install NVIDIA driver and CUDA applications
• fluent-bit - Install Fluent-Bit to monitor the local machine
• proxy - Install envoy proxy to expose the Model Server, Fluent-Bit and Admin ports with mTLS
• ollama - Install and configure Ollama

Installation Playbook

The collection includes a playbook for the installation

• install for provisioning ollama with an insecure port. By default, the port is exposed only within the local network

Installer playbook variables

The installer playbook has additional variables

install_nvidia

Install NVIDIA drivers and applications.

Default is false

proxy_model_server_local_port

The local port of the model server.

The default value is set based on the model server type which is set by the inventory

proxy_model_server_secure_port

The external port of the model server.

The default value is set based on the model server type which is set by the inventory

Inventory machine types

ollama

To install the ollama model server create an inventory file indicating the machine type - ollama.

Sample Inventory

all:
  hosts:
  children:
    ollama:
      hosts:
        ollama.example.com:

Sample Installation Options

Local server

This is the default installation. No extra parameters are required

Server with mTLS - Local Certificates

proxy_certificate_ca_file: "/path/to/ca"
proxy_certificate_cert_file: "/path/to/crt"
proxy_certificate_key_file: "/path/to//key"

Server with mTLS - Kubernetes Certificate Manager

proxy_use_k8s_cert_manager: true
proxy_certificate_namespace: < Namespace of the CA Issuer and Certificate >
proxy_certificate_ca_issuer: < Name of the CA Issuer >
proxy_fqdn: < Server FQDN >

Using the installer

ansible-playbook -i  </path/to/inventory> -e @</path/to/env_file> ygalblum.ollama.install

Installing the collection from Ansible Galaxy

Before using this collection, you need to install it with the Ansible Galaxy command-line tool:

ansible-galaxy collection install ygalblum.ollama

You can also include it in a requirements.yml file and install it with ansible-galaxy collection install -r requirements.yml, using the format:

---
collections:
  - name: ygalblum.ollama

Note that if you install the collection from Ansible Galaxy, it will not be upgraded automatically when you upgrade the ansible package. To upgrade the collection to the latest available version, run the following command:

ansible-galaxy collection install ygalblum.ollama --upgrade

You can also install a specific version of the collection. For example, if you need to downgrade when something is broken in the latest version (please report an issue in this repository). Use the following syntax to install version 1.0.0:

ansible-galaxy collection install ygalblum.ollama:==1.0.0

See Using Ansible collections for more details.

Contributing

We appreciate participation from any new contributors. Get started by opening an issue or pull request.

Refer to our contribution guide for more information

Reporting issues

Please open a new issue for any bugs or security vulnerabilities you may encounter. We also invite you to open an issue if you have ideas on how we can improve the solution or want to make a suggestion for enhancement.

Release notes

See the changelog.

Licensing

See LICENSE to see the full text.