Truss is an open source framework for writing model server code in Python. It also contains a CLI to power your developer workflows.

We recommend always using the latest version of Truss, which you can update or install with:

pip install --upgrade truss

​
Truss configuration options

Every model packaged with Truss uses a config.yaml to specify hardware requirements, software dependencies, and other model serving setup.

The Truss config reference details the dozens of supported configuration options.

​
Truss CLI

The Truss CLI runs the core developer loop of deploying models to Baseten. See the Truss CLI reference for a complete list of commands and options or run truss --help.

Config options