Skip to main content
This page lists the anaconda ai command group and shared concepts. Each command has a dedicated reference page; select a command to view its options and examples.

Commands

Concepts

Backend
The local application that manages model files and inference servers. Supported backends are anaconda-desktop (default) and ai-catalyst. Use the --backend option to override the default, or set it permanently with anaconda ai config.
Model reference
A string that identifies a specific quantized model: [author/]model_name/quantization[.format]. See Getting started for details.
Server
An OpenAI-compatible inference server running a quantized model. Each server is assigned a unique ID and exposes an HTTP endpoint for making requests.
Site
A named connection profile defined in ~/.anaconda/config.toml. Use --at to target a specific site on commands that support it.

Global options

The following options are shared across most commands:
Not every command supports --backend and --at. Refer to each command’s reference page for the exact options available.