{% set is_downloading = gateway.models | selectattr('download_state', 'equalto', 'downloading') | list | length > 0 %}
{% if feedback %} {% endif %}
Inference Server {% if gateway.status.value == 'ok' %} Online {% else %} Unavailable {% endif %}

Local models served by llama-swap. Download a model to make it available for inference.

{% if gateway.status.value == 'ok' and gateway.endpoint_url %}
{% endif %} {% if gateway.status.value != 'ok' %}

The swapboard API could not be reached. Check that it is running and reachable.

{% elif gateway.models %}
{% for model in gateway.models %} {# A model llama-swap currently holds says more than that its files are on disk, so the live state stands in for "Available". A download that failed outranks both: it is the only status carrying an error to act on, and llama-swap reporting `error` for the model it could not start must not bury the reason it could not. #} {% set live_state = state_badge(model.meta.state) if model.meta else None %} {% endfor %}
Name Repository Details Capabilities Size Status Actions
{{ model.name }} {{ model.repo_id }} {% include "partials/model_details.html" %} {% include "partials/model_capabilities.html" %} {% if model.size_bytes %}{{ model.size_bytes | filesizeformat(true) }}{% else %}—{% endif %} {% if model.download_state.value == 'downloading' %} Downloading {% elif model.download_state.value == 'failed' %} Failed {% elif live_state %} {{ live_state.label }} {% elif model.present or model.download_state.value == 'completed' %} Available {% else %} Not downloaded {% endif %} {% set is_present = model.present or model.download_state.value == 'completed' %} {% set in_progress = model.download_state.value == 'downloading' %}
{% else %}

No models are configured in llama-swap.

{% endif %}
{% if gateway.stray %}
Stray models

These GGUF files are on disk but no longer referenced by the llama-swap configuration. Removing them frees the space.

{% for stray in gateway.stray %} {% endfor %}
Location Files Size Actions
{{ stray.relative_path }} {{ stray.files | length }} {{ stray.size_bytes | filesizeformat(true) }}
{% endif %}