- Public Hugging Face models (default)
- Bundled directly in Truss
1. Bundling model weights in Truss
Store model files inside Truss using thedata/
directory.
Example: Stable Diffusion 2.1 Truss structure
model.py
:
Limitation: Large weights increase deployment size, making it slower. Consider
cloud storage instead.
2. Loading private model weights from S3
If using private S3 storage, first configure secure authentication.Step 1: Define AWS secrets in config.yaml
Do not store actual credentials here. Add them securely to Baseten secrets
manager.