Setup & Dependencies
Base Docker images
A guide to configuring a base image for your truss
Truss uses containerized environments to ensure consistent model execution across deployments. While the default Truss image works for most cases, you may need a custom base image to meet specific package or system requirements.
Setting a base image inconfig.yaml
Specify a custom base image in config.yaml
:
config.yaml
image
: The Docker image to use.python_executable_path
: The path to the Python binary inside the container.
Example: NVIDIA NeMo Model
Using a custom image to deploy NVIDIA NeMo TitaNet model:
config.yaml
Using Private Base Images
If your base image is private, ensure that you have configured your model to use a private registry
Creating a custom base image
You can build a new base image using Truss’s base images as a foundation. Available images are listed on Docker Hub.
Example: Customizing a Truss Base Image
Dockerfile
Building & Pushing Your Custom Image
Ensure Docker is installed and running. Then, build, tag, and push your image: