A guide to configuring a base image for your truss
Truss uses containerized environments to ensure consistent model execution across deployments. While the default Truss image works for most cases, you may need a custom base image to meet specific package or system requirements.
config.yaml
Specify a custom base image in config.yaml
:
image
: The Docker image to use.python_executable_path
: The path to the Python binary inside the container.Using a custom image to deploy NVIDIA NeMo TitaNet model:
If your base image is private, ensure that you have configured your model to use a private registry
You can build a new base image using Truss’s base images as a foundation. Available images are listed on Docker Hub.
Ensure Docker is installed and running. Then, build, tag, and push your image: