Skip to main content
Manage your deployment through its lifecycle. After you push a model, promote its deployment to serve an environment, deactivate it to stop compute spend, activate it to bring it back, and delete it when you no longer need it. For what each deployment state means, see Deployments.

Promote to an environment

Promote a validated deployment to production (or a custom environment) to route that environment’s traffic to it. What happens to the previously promoted deployment is controlled by the target environment’s promotion cleanup strategy; see Environments for the concepts and Rolling deployments for incremental traffic shifting.
To promote a deployment:
  1. Sign in to your workspace at app.baseten.co and choose Dedicated Inference in the sidebar.
  2. Select your model.
  3. Select the deployment under Deployments.
  4. Choose Promote to….
  5. In the Promote deployment dialog, choose the target environment.
  6. Choose Promote to confirm.
Promotion routes the environment’s traffic to the new deployment. Verify it:
To verify the promotion:
  1. Sign in to your workspace at app.baseten.co and choose Dedicated Inference in the sidebar.
  2. Select your model.
  3. On the model’s overview, confirm the environment card’s Current deployment shows your deployment.
For more information, see the promote deployment and promote to environment endpoints.

Deactivate a deployment

Deactivate a deployment to stop compute spend without deleting it. The deployment keeps its configuration and stays visible in the dashboard, but releases its replicas. Requests to a deactivated deployment fail with a 400 error; see troubleshooting for the error and recovery.
To deactivate a deployment:
  1. Sign in to your workspace at app.baseten.co and choose Dedicated Inference in the sidebar.
  2. Select your model.
  3. Select the deployment under Deployments.
  4. Choose Deactivate deployment.
  5. Choose Yes, deactivate to confirm.
The deployment’s status moves to INACTIVE within a few seconds. If you want the deployment to keep serving but stop paying for idle replicas, scale to zero instead.

Activate a deployment

Activate an inactive deployment to bring it back. Activation redeploys the model, so the deployment passes through DEPLOYING before reaching ACTIVE.
To activate a deployment:
  1. Sign in to your workspace at app.baseten.co and choose Dedicated Inference in the sidebar.
  2. Select your model.
  3. Select the inactive deployment under Deployments.
  4. Choose Activate deployment.
For more information, see activate and the activate endpoint.

Delete a deployment

Delete deployments to clean up finished experiments and stale versions.
Deletion is irreversible, and requests to a deleted deployment return 404. Deactivate instead if you might need the deployment again.
A deployment that’s associated with an environment, or is the only deployment of a model, can’t be deleted; push a new deployment and promote it first, or delete the whole model.
To delete a deployment:
  1. Sign in to your workspace at app.baseten.co and choose Dedicated Inference in the sidebar.
  2. Select your model.
  3. Select the deployment under Deployments.
  4. Choose Delete deployment and confirm.
The button is disabled while the deployment serves an environment or is the model’s only deployment.
You can also delete the model itself, which removes all of its deployments:
To delete a model:
  1. Sign in to your workspace at app.baseten.co and choose Dedicated Inference in the sidebar.
  2. Select your model.
  3. On the model’s overview, choose Actions, then Delete model.
  4. Type the model’s name to confirm, then choose Delete.
For more information, see the delete deployment and delete model endpoints, and the CLI’s delete reference.

Next steps

With lifecycle transitions scripted, the same commands slot into CI jobs, cron cleanups, and incident runbooks.