hf_access_token in workspace secrets to download the base weights from Hugging Face. A run with base_checkpoint_auth deploys with those credentials. Only runs that start from Hugging Face weights can be deployed.
Deploy from the CLI
To deploy a checkpoint: Runbaseten loops checkpoint deploy with the checkpoint’s globally unique id (the id field from listing checkpoints), by checkpoint name scoped to a run, or with the Truss CLI:
hf_access_token). A successful deploy prints the IDs you need to call the model:
Output
ACTIVE.
Use the Baseten CLI for interactive checkpoint deployment. To inspect the generated Truss config before creating an inference deployment, pass --dry-run:
--dry-run when you’re ready to deploy.
To customize the config, save the printed YAML as config.yaml in a Truss directory and edit it. Deploy with baseten model push, using the same CLI profile as the preview and the checkpoint’s team:
--team, model push uses the organization’s default team, which can differ from the checkpoint’s team and cause deployment to fail. The Hugging Face secret must also be available in the checkpoint’s team.
Deploy from the REST API
To deploy a checkpoint: CallPOST /v1/loops/checkpoints/deploy. Replace <id> with the checkpoint’s globally unique id, choose an instance type id from the instance-type catalog, and set the model name and Hugging Face secret:
Request
Response
Deploy from the dashboard
Every Loop has a page in the dashboard atapp.baseten.co/training/loop/<run_id>, reachable from the Training tab. Its Checkpoints table lists each saved checkpoint with its bt:// path, type, and size. Deploy one from that table; the flow matches deploying job checkpoints.
Call the deployed model
Call the deployment’s OpenAI-compatible chat completions route. The URL includes the deployment ID, andmodel is the checkpoint name (checkpoint_id), not its globally unique id:
Request
Output
Delete the deployment
Delete it withDELETE /v1/models/{model_id} when you’re done:
Request
Output
Next steps
- Train on a chat dataset: Move from the quickstart’s single example to a real training loop.
- Loops concepts: How checkpoints relate to sessions, trainers, and samplers.