Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.baseten.co/llms.txt

Use this file to discover all available pages before exploring further.

truss watch [OPTIONS] [TARGET_DIRECTORY]
Watches for source code changes and applies live patches to a development deployment. This enables rapid iteration without redeploying.
You can create a development deployment and start watching in one step with truss push --watch.

Options

}
--config
PATH
Path to a custom config file. Defaults to config.yaml in the Truss directory.
--remote
TEXT
Name of the remote in .trussrc to patch changes to.
--team
TEXT
Name of the team to deploy to. If not specified, Truss infers the team based on your team membership and existing models, or prompts for selection when ambiguous.
The --team flag is only available if your organization has teams enabled. Contact us to enable teams, or see Teams for more information.
--no-sleep
BOOLEAN
default:"true"
Keep the development model warm by preventing scale-to-zero while watching. Default is true. Pass --no-sleep=false to disable.
--hot-reload
Apply model code changes by swapping the model class in-process without restarting the inference server. Preserves in-memory state like loaded weights and caches, but does not re-run __init__() or load(). If your changes add new instance state that predict() depends on, do a full reload instead. When creating a new deployment with truss push --watch, use --watch-hot-reload instead.
--model-name
TEXT
Temporarily overrides the model name for this session without updating config.yaml.
--tail
Stream deployment logs while watching.
--log
humanfriendly | W | WARNING | I | INFO | D | DEBUG
default:"humanfriendly"
Logging verbosity. humanfriendly (default) is pretty-printed; INFO, DEBUG, WARNING produce structured logs.
--non-interactive
Disable interactive prompts. Use in CI/automated contexts where stdin isn’t a TTY.

Arguments

TARGET_DIRECTORY
TEXT
A Truss directory. Defaults to current directory.
Examples: Watch for changes in the current directory:
truss watch
You should see:
🪵  View logs for your development model at https://app.baseten.co/models/.../logs
👀 Watching for changes to truss at '/path/to/my-model'...
When you edit a file, Truss detects the change and applies a live patch to the running deployment. Watch a specific Truss directory:
truss watch /path/to/my-truss
Watch with a custom config file:
truss watch --config my-config.yaml