Skip to main content

list

List the checkpoints a training job has synced, newest first. Checkpoints only appear for jobs that enabled checkpointing.

Options

TEXT
default:"desc"
Sort order by creation time: ‘desc’ (newest first) or ‘asc’ (oldest first).One of: asc, desc
TEXT
required
ID of the training job.
TEXT
Filter JSON output with a jq expression; implies —output json (or jsonl for streamed commands)
TEXT
default:"text"
Output formatOne of: text, json, jsonl, none
TEXT
Use a specific stored profile for this command, overriding BASETEN_PROFILE and the current profile
BOOL
Enable verbose logging

Examples

List a job’s checkpoints
List a job’s checkpoints oldest first

Filter output with --jq

Print just the checkpoint IDs

Output

Text mode (--output text): Table with columns: ID, TYPE, BASE MODEL, SIZE, SYNC, CREATED. When the job has no checkpoints, prints “No checkpoints found.” to stderr. JSON mode (--output json): payload type managementapi.GetTrainingJobCheckpointsResponse.

files

List presigned download URLs for the files of a training job’s checkpoints. The URLs are short-lived. For machine-readable streaming, prefer —output jsonl over —output json.

Options

TEXT
required
ID of the training job.
TEXT
Filter JSON output with a jq expression; implies —output json (or jsonl for streamed commands)
TEXT
default:"text"
Output formatOne of: text, json, jsonl, none
TEXT
Use a specific stored profile for this command, overriding BASETEN_PROFILE and the current profile
BOOL
Enable verbose logging

Examples

List every checkpoint file of a job
Save the URLs to a file for a download script

Filter output with --jq

Print just the download URLs

Output

Text mode (--output text): Table with columns: NODE, NAME, SIZE, MODIFIED, URL. When there are no files, prints “No checkpoint files found.” to stderr. JSON mode (--output json): payload type managementapi.CheckpointFile.

deploy

Deploy a training job’s LoRA checkpoints as a model served by vLLM. Without —config, the checkpoints and the model that serves them are chosen interactively. Pass —config for a repeatable deploy: it is a Python file defining a DeployCheckpointsConfig, so it is executed rather than read. The generated model config is written to disk either way, so a deploy can be re-run or edited by hand afterward.

Options

TEXT
Python file defining a DeployCheckpointsConfig: which checkpoints deploy and the model that serves them.
TEXT
Directory the generated model config is written to. Defaults to a directory under ./truss_configs.
BOOL
Write the generated model config without deploying anything.
TEXT
Training job whose checkpoints are deployed. Required unless —config names them.
TEXT
Filter JSON output with a jq expression; implies —output json (or jsonl for streamed commands)
TEXT
default:"text"
Output formatOne of: text, json, jsonl, none
TEXT
Use a specific stored profile for this command, overriding BASETEN_PROFILE and the current profile
TEXT
Run this truss executable instead of fetching one with uv, e.g. a virtualenv’s bin/truss. A value with no path separator is looked up on PATH, so ‘—truss-executable truss’ runs the truss you installed. Defaults to BASETEN_TRUSS_EXECUTABLE.
BOOL
Do not forward this CLI’s credentials to truss, leaving it to resolve a remote from your trussrc. Old truss versions ignore forwarded credentials and use the trussrc regardless.
TEXT
Version of truss to fetch and run with ‘uv tool run’, e.g. 0.18.26. Defaults to BASETEN_TRUSS_VERSION, or the latest release. Mutually exclusive with —truss-executable.
BOOL
Enable verbose logging

Examples

Deploy a job’s checkpoints, choosing them interactively
Deploy the checkpoints a config file names
Generate the model config without deploying

Output

Text mode (--output text): The new model and deployment IDs with links to the deployment’s logs, the path the model config was written to, and an example request naming the deployed checkpoints. With —dry-run, only the config path. JSON mode (--output json): payload type cmd.TrussDelegatedResult. Under —output json the text output goes to stderr and stdout is an empty object: this command reports nothing structured yet.