Skip to content

Switch the bundled model

waired init auto-selects a bundled model from your hardware profile — the largest model that fits this machine above a coding-quality floor (a capable box gets a large MoE coder; a modest laptop gets a smaller model). To override that pick — say a larger model on a 24 GB GPU, or a smaller one to save memory — set the bundled model ID explicitly. Browse the options and their requirements in the model catalog.

There are three ways to set it. When more than one is present, the higher-priority source wins:

defaults < agent.json < environment variable < CLI flag
Section titled “1. agent.json (persistent — recommended)”

Set inference.bundled_model_id in agent.json, then restart the service.

Config file: ~/.config/waired/agent.json (respects XDG_CONFIG_HOME); for the system daemon, /etc/waired/agent.json.

Terminal window
sudo jq '.inference.bundled_model_id = "qwen3-coder-30b-a3b-instruct"' \
/etc/waired/agent.json | sudo tee /etc/waired/agent.json.new
sudo mv /etc/waired/agent.json.new /etc/waired/agent.json
sudo systemctl restart waired-agent

2. Environment variable (system-wide / temporary)

Section titled “2. Environment variable (system-wide / temporary)”

Set WAIRED_INFERENCE_BUNDLED_MODEL_ID and restart the service.

Add it to /etc/waired/agent.env:

Terminal window
sudo install -m 600 -D /dev/stdin /etc/waired/agent.env <<'EOF'
WAIRED_INFERENCE_BUNDLED_MODEL_ID=qwen3-coder-30b-a3b-instruct
EOF
sudo systemctl restart waired-agent

(Keep your existing WAIRED_CONTROL_URL line if the file already has one.)

Pass the flag when starting the agent directly:

Terminal window
waired-agent --inference-bundled-model-id=qwen3-coder-30b-a3b-instruct

After restarting, the new model is pulled on demand (this can take a few minutes):

Terminal window
waired models ls # watch the download / disk usage
waired status --observability # the Engine line should show the new model=