Truss is an open source framework for writing model server code in Python. It also contains a CLI to power your developer workflows.

We recommend always using the latest version of Truss, which you can update or install with:

pip install --upgrade truss

Truss configuration options

Every model packaged with Truss uses a config.yaml to specify hardware requirements, software dependencies, and other model serving setup.

The Truss config reference details the dozens of supported configuration options.

Truss CLI

The Truss CLI runs the core developer loop of deploying models to Baseten. See the Truss CLI reference for a complete list of commands and options or run truss --help.