> ## Documentation Index
> Fetch the complete documentation index at: https://docs.controlplane.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Ollama

> Deploy Ollama on Control Plane using the Template Catalog. Covers configuration, volumes, scaling, and LLM serving with Open WebUI sidecar and automatic model pulling.

## Overview

Ollama is an open-source platform for running large language models locally. This template deploys Ollama alongside Open WebUI as a sidecar interface, with a startup script that automatically pulls the configured default model on first launch. The Ollama API is accessible internally, while the Open WebUI is exposed externally.

### What Gets Created

* **Stateful Workload** — A single-replica workload with two containers: the Ollama API server and the Open WebUI interface. The API runs on port `11434` (internal only) and the UI runs on port `8080` (externally accessible).
* **Volume Set** — Persistent storage shared by both containers: the Ollama API stores model data at `/root/.ollama` and Open WebUI stores state at `/app/backend/data`. Supports optional autoscaling.
* **Secret** — An opaque startup script that checks for the default model on launch and pulls it from the Ollama registry if not already present.
* **Identity & Policy** — An identity bound to the workload with `reveal` access to the startup script secret.

<Note>
  This template does not create a GVC. You must deploy it into an existing GVC.
</Note>

## Installation

<Note>
  The default configuration requests 6 CPU and 8Gi of memory for the Ollama API container. Depending on your organization's quotas, you may need to request a limit increase. GPU access requires explicit enablement — contact Control Plane support to enable GPU resources for your organization.
</Note>

To install, follow the instructions for your preferred method:

<CardGroup cols={2}>
  <Card title="UI" href="/template-catalog/install-manage/ui" icon="laptop">
    Browse, install, and manage templates visually
  </Card>

  <Card title="CLI" href="/template-catalog/install-manage/cli" icon="terminal">
    Manage templates from your terminal
  </Card>

  <Card title="Terraform" href="/template-catalog/install-manage/terraform" icon={<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 128 128"><g fill-rule="evenodd"><path d="M77.941 44.5v36.836L46.324 62.918V26.082zm0 0" fill="#5c4ee5"/><path d="M81.41 81.336l31.633-18.418V26.082L81.41 44.5zm0 0" fill="#4040b2"/><path d="M11.242 42.36L42.86 60.776V23.941L11.242 5.523zm0 0M77.941 85.375L46.324 66.957v36.82l31.617 18.418zm0 0" fill="#5c4ee5"/></g></svg>}>
    Declare templates in your Terraform configurations
  </Card>

  <Card
    title="Pulumi"
    href="/template-catalog/install-manage/pulumi"
    icon={<svg xmlns="http://www.w3.org/2000/svg" fill="none" viewBox="0 0 24 24" id="Pulumi-Icon--Streamline-Svg-Logos" height="24" width="24">
    <desc>
        Pulumi Icon Streamline Icon: https://streamlinehq.com
    </desc>
    <path fill="#f26e7e" d="M4.683025 13.3318c0.869125 -0.5018 0.870575 -2.1264 0.003225 -3.62865s-2.27504 -2.313275 -3.1441725 -1.811475C0.672945 8.3935 0.6715 10.0181 1.53885 11.52035c0.86735 1.502275 2.27505 2.313275 3.144175 1.81145Zm0.0052 3.2167c0.86735 1.502275 0.865925 3.126875 -0.003225 3.628675 -0.86915 0.5018 -2.2768275 -0.309225 -3.144175 -1.81145 -0.8673525 -1.50225 -0.8659075 -3.126875 0.003225 -3.628675 0.8691325 -0.5018 2.276825 0.309225 3.144175 1.81145Zm5.922875 3.4243c0.86735 1.50225 0.8659 3.126775 -0.003225 3.62875 -0.869125 0.501775 -2.27685 -0.309325 -3.1442 -1.81155 -0.867325 -1.50225 -0.865875 -3.12685 0.00325 -3.628675 0.869125 -0.5018 2.276825 0.309225 3.144175 1.811475Zm-0.001925 -6.845275c0.86735 1.50225 0.8659 3.12685 -0.003225 3.628675 -0.869125 0.5018 -2.276825 -0.309225 -3.144175 -1.811475 -0.86735 -1.50225 -0.8659 -3.12685 0.003225 -3.62865 0.869125 -0.501825 2.276825 0.3092 3.144175 1.81145Z" stroke-width="0.25"></path>
    <path fill="#8a3391" d="M22.45775 11.524125c0.86725 -1.502225 0.865925 -3.12685 -0.003225 -3.62865 -0.869125 -0.501825 -2.276825 0.3092 -3.144175 1.811475 -0.86735 1.50225 -0.8659 3.126825 0.003225 3.62865 0.869125 0.501825 2.276825 -0.3092 3.144175 -1.811475Zm0.000175 3.2151c0.869075 0.5018 0.870625 2.1264 0.003225 3.62865 -0.86735 1.50225 -2.27505 2.313275 -3.144175 1.81145 -0.869125 -0.5018 -0.870575 -2.126425 -0.003225 -3.62865 0.86735 -1.50225 2.27505 -2.313275 3.144175 -1.81145ZM16.536225 18.157875c0.86915 0.501825 0.8706 2.126425 0.00325 3.628675 -0.86735 1.502125 -2.275075 2.313225 -3.1442 1.81145 -0.869125 -0.50175 -0.870575 -2.126425 -0.003225 -3.62865 0.867375 -1.502275 2.27505 -2.3133 3.144175 -1.811475Zm-0.003325 -6.843775c0.869125 0.5018 0.870575 2.126425 0.003225 3.628675s-2.27505 2.313275 -3.1442 1.811475c-0.869125 -0.501825 -0.870575 -2.126425 -0.003225 -3.628675 0.86735 -1.502275 2.27505 -2.313275 3.1442 -1.811475Z" stroke-width="0.25"></path>
    <path fill="#f7bf2a" d="M15.138225 2.06721c0 1.003615 -1.40625 1.817215 -3.14095 1.817215 -1.7347 0 -3.14095 -0.8136 -3.14095 -1.817215C8.856325 1.06359 10.262575 0.25 11.997275 0.25c1.7347 0 3.14095 0.81359 3.14095 1.81721ZM9.2166 5.482375c0 1.003625 -1.40625 1.8172 -3.14095 1.8172 -1.7347 0 -3.14095 -0.813575 -3.14095 -1.8172s1.40625 -1.817225 3.14095 -1.817225c1.7347 0 3.14095 0.8136 3.14095 1.817225Zm8.71005 1.8172c1.7347 0 3.14095 -0.813575 3.14095 -1.8172s-1.40625 -1.817225 -3.14095 -1.817225c-1.7347 0 -3.14095 0.8136 -3.14095 1.817225s1.40625 1.8172 3.14095 1.8172Zm-2.788425 1.605625c0 1.003625 -1.40625 1.8172 -3.14095 1.8172 -1.7347 0 -3.14095 -0.813575 -3.14095 -1.8172 0 -1.0036 1.40625 -1.8172 3.14095 -1.8172 1.7347 0 3.14095 0.8136 3.14095 1.8172Z" stroke-width="0.25"></path>
    </svg>}
  >
    Declare templates in your Pulumi programs
  </Card>
</CardGroup>

## Configuration

The default `values.yaml` for this template:

```yaml theme={null}
# Alternatives: llava, gemma, mistral, phi3, etc.
defaultModel: llama3

workload:
  containers:
    ui:
      name: ollama-ui
      image: ghcr.io/open-webui/open-webui:main
      port: 8080
      resources:
        cpu: 500m
        memory: 1Gi
    api:
      name: ollama
      image: ollama/ollama
      port: 11434
      resources:
        cpu: 6
        memory: 8Gi
      gpu:
        nvidia:
          model: t4
          quantity: 1

volumeset:
  initialCapacity: 10
  autoscaling:
    enabled: false
    maxCapacity: 100 # Maximum capacity in GiB
    minFreePercentage: 10 # Trigger scaling when free space drops below this percentage
    scalingFactor: 1.2 # Multiply current capacity by this factor when scaling up
  performanceClass: general-purpose-ssd
  snapshots:
    retentionDuration: 7d

firewall:
  external:
    inboundAllowCIDR:
      - 0.0.0.0/0
    outboundAllowCIDR:
      - 0.0.0.0/0

internal_access:
  type: same-gvc # options: same-gvc, same-org, workload-list
  workloads: # Note: can only be used if type is same-gvc or workload-list
    #- //gvc/GVC_NAME/workload/WORKLOAD_NAME
```

### Default Model

* `defaultModel` — The Ollama model to download on first startup if not already present on the volume. Accepts any model name from the [Ollama model library](https://ollama.com/library) (e.g. `llama3`, `llava`, `gemma`, `mistral`, `phi3`).

### Open WebUI Container

* `workload.containers.ui.image` — Open WebUI container image.
* `workload.containers.ui.port` — Port the UI listens on (default: `8080`).
* `workload.containers.ui.resources.cpu` / `workload.containers.ui.resources.memory` — CPU and memory for the UI container.

### Ollama API Container

* `workload.containers.api.image` — Ollama container image.
* `workload.containers.api.port` — Port the Ollama API listens on (default: `11434`).
* `workload.containers.api.resources.cpu` / `workload.containers.api.resources.memory` — CPU and memory for the Ollama API container. Large models require significant resources.
* `workload.containers.api.gpu` — Optional GPU configuration:
  * `nvidia.model` — GPU model type (e.g. `t4`).
  * `nvidia.quantity` — Number of GPUs to allocate.

<Note>
  GPU access must be explicitly enabled for your organization by Control Plane support before it can be used in a workload.
</Note>

### Storage

* `volumeset.initialCapacity` — Initial volume size in GiB (minimum 10). Large models require more storage — plan accordingly.
* `volumeset.autoscaling.enabled` — Automatically expand the volume as it fills. When enabled:
  * `maxCapacity` — Maximum volume size in GiB.
  * `minFreePercentage` — Trigger a scale-up when free space drops below this percentage.
  * `scalingFactor` — Multiply the current capacity by this factor when scaling up.

### Firewall

* `firewall.external.inboundAllowCIDR` — CIDR ranges allowed to access the Open WebUI externally (default: `0.0.0.0/0`).
* `firewall.external.outboundAllowCIDR` — CIDR ranges the workload can reach externally. Must include `0.0.0.0/0` (or the Ollama registry) for model downloads to succeed.

### Internal Access

* `internal_access.type` — Controls which workloads can reach the Ollama API on port `11434` internally:

| Type            | Description                                                     |
| --------------- | --------------------------------------------------------------- |
| `same-gvc`      | Allow access from all workloads in the same GVC                 |
| `same-org`      | Allow access from all workloads in the same organization        |
| `workload-list` | Allow access only from specific workloads listed in `workloads` |

### Accessing Ollama

**Open WebUI** (browser interface) is available externally at:

```text theme={null}
https://RELEASE_NAME-ollama.GVC_NAME.cpln.app
```

**Ollama API** is available internally to other workloads in the same GVC at:

```text theme={null}
http://RELEASE_NAME-ollama.GVC_NAME.cpln.local:11434
```

## External References

<CardGroup cols={2}>
  <Card title="Ollama Documentation" icon="book" href="https://github.com/ollama/ollama">
    Official Ollama repository and documentation
  </Card>

  <Card title="Open WebUI" icon="browser" href="https://github.com/open-webui/open-webui">
    Open WebUI repository and documentation
  </Card>

  <Card title="Ollama Model Library" icon="database" href="https://ollama.com/library">
    Browse available models for Ollama
  </Card>

  <Card title="Ollama Template" icon="github" href="https://github.com/controlplane-com/templates/tree/main/ollama">
    View the source files, default values, and chart definition
  </Card>
</CardGroup>