Update model environment

PATCH

models

{model_id}

environments

{env_name}

cURL

curl --request PATCH \
--url https://api.baseten.co/v1/models/{model_id}/environments/{env_name} \
--header "Authorization: Api-Key $BASETEN_API_KEY" \
--data '{
  "autoscaling_settings": {
    "autoscaling_window": 800,
    "concurrency_target": 3,
    "max_replica": 2,
    "min_replica": 1,
    "scale_down_delay": 60,
    "target_utilization_percentage": null
  },
  "promotion_settings": {
    "ramp_up_duration_seconds": 600,
    "ramp_up_while_promoting": true,
    "redeploy_on_promotion": true,
    "rolling_deploy": null
  }
}'

{
  "status": "ACCEPTED",
  "message": "<string>"
}

Authorizations

Authorization

string

header

required

You must specify the scheme 'Api-Key' in the Authorization header. For example, Authorization: Api-Key <Your_Api_Key>

Path Parameters

model_id

string

required

env_name

string

required

Body

application/json

A request to update an environment.

autoscaling_settings

UpdateAutoscalingSettingsV1 · object

Autoscaling settings for the environment

Show child attributes

autoscaling_settings.min_replica

integer | null

Minimum number of replicas

Example:

0

autoscaling_settings.max_replica

integer | null

Maximum number of replicas

Example:

7

autoscaling_settings.autoscaling_window

integer | null

Timeframe of traffic considered for autoscaling decisions

Example:

600

autoscaling_settings.scale_down_delay

integer | null

Waiting period before scaling down any active replica

Example:

120

autoscaling_settings.concurrency_target

integer | null

Number of requests per replica before scaling up

Example:

2

autoscaling_settings.target_utilization_percentage

integer | null

Target utilization percentage for scaling up/down.

Example:

70

Example:

{
  "autoscaling_window": 800,
  "concurrency_target": 3,
  "max_replica": 2,
  "min_replica": 1,
  "scale_down_delay": 60,
  "target_utilization_percentage": null
}

promotion_settings

UpdatePromotionSettingsV1 · object

Promotion settings for the environment

Show child attributes

promotion_settings.redeploy_on_promotion

boolean | null

Whether to deploy on all promotions. Enabling this flag allows model code to safely handle environment-specific logic. When a deployment is promoted, a new deployment will be created with a copy of the image.

Example:

true

promotion_settings.rolling_deploy

boolean | null

Whether the environment should rely on rolling deploy orchestration.

Example:

true

promotion_settings.ramp_up_while_promoting

boolean | null

Whether to ramp up traffic while promoting

Example:

true

promotion_settings.ramp_up_duration_seconds

integer | null

Duration of the ramp up in seconds

Example:

600

Example:

{
  "ramp_up_duration_seconds": 600,
  "ramp_up_while_promoting": true,
  "redeploy_on_promotion": true,
  "rolling_deploy": null
}

Response

200 - application/json

The response to a request to update autoscaling settings.

status

enum<string>

required

Status of the request to update autoscaling settings

Available options:

ACCEPTED,

QUEUED,

UNCHANGED

message

string

required

A message describing the status of the request to update autoscaling settings

Create Chain environmentCreate a chain environment. Returns the resulting environment.

⌘I

cURL

curl --request PATCH \
--url https://api.baseten.co/v1/models/{model_id}/environments/{env_name} \
--header "Authorization: Api-Key $BASETEN_API_KEY" \
--data '{
  "autoscaling_settings": {
    "autoscaling_window": 800,
    "concurrency_target": 3,
    "max_replica": 2,
    "min_replica": 1,
    "scale_down_delay": 60,
    "target_utilization_percentage": null
  },
  "promotion_settings": {
    "ramp_up_duration_seconds": 600,
    "ramp_up_while_promoting": true,
    "redeploy_on_promotion": true,
    "rolling_deploy": null
  }
}'

{
  "status": "ACCEPTED",
  "message": "<string>"
}

Reference

Inference API

Management API

CLI reference

SDK reference

Update model environment

Authorizations

Path Parameters

Body

Response