{% set is_downloading = gateway.models | selectattr('download_state', 'equalto', 'downloading') | list | length > 0 %}
Local models served by llama-swap. Download a model to make it available for inference.
{% if gateway.status.value == 'ok' and gateway.endpoint_url %}The swapboard API could not be reached. Check that it is running and reachable.
{% elif gateway.models %}| Name | Repository | Details | Capabilities | Size | Status | Actions |
|---|---|---|---|---|---|---|
| {{ model.name }} | {{ model.repo_id }} | {% include "partials/model_details.html" %} | {% include "partials/model_capabilities.html" %} | {% if model.size_bytes %}{{ model.size_bytes | filesizeformat(true) }}{% else %}—{% endif %} | {# A model llama-swap currently holds says more than that its files are on disk, so the live state stands in for "Available". A download that failed outranks both: it is the only status carrying an error to act on, and llama-swap reporting `error` for the model it could not start must not bury the reason it could not. #} {% set live_state = state_badge(model.meta.state) if model.meta else None %}{% if model.download_state.value == 'downloading' %} Downloading {% elif model.download_state.value == 'failed' %} Failed {% elif live_state %} {{ live_state.label }} {% elif model.present or model.download_state.value == 'completed' %} Available {% else %} Not downloaded {% endif %} |
{% set is_present = model.present or model.download_state.value == 'completed' %}
{% set in_progress = model.download_state.value == 'downloading' %}
|
No models are configured in llama-swap.
{% endif %}These GGUF files are on disk but no longer referenced by the llama-swap configuration. Removing them frees the space.
| Location | Files | Size | Actions |
|---|---|---|---|
| {{ stray.relative_path }} | {{ stray.files | length }} | {{ stray.size_bytes | filesizeformat(true) }} |
|