Skip to main content
POST
cURL

Authorizations

Authorization
string
header
required

Send Authorization: Bearer <api_key>. The legacy Authorization: Api-Key <api_key> scheme is also accepted.

Body

application/json

A request to create a BIS-LLM model

resources
Resources · object
required

Resources allocated to the model

name
string
required

Name of the model

deployment_name
string | null

Name of the deployment, unique within the model. Use only A-Z, a-z, 0-9, '-', '_', and '.'. The name 'development' is reserved. If omitted or empty, a name is generated automatically.

region
string | null

Region in which to deploy the model

llm_version
string | null

Version of the helm chart to use.

llm_config
Llm Config · object

Configuration specific to the LLM model

environment_variables
Environment Variables · object

Environment variables for the model

model_metadata
Model Metadata · object | null

Model metadata persisted into model_config

autoscaling_settings
UpdateAutoscalingSettingsV1 · object | null

Autoscaling settings for the model

Example:
additional_autoscaling_config
Additional Autoscaling Config · object | null

Additional autoscaling configuration (e.g. target in-flight tokens)

Example:
metadata
Metadata · object | null

User-defined metadata for the deployment

Example:
weights
Weights · object[] | null

Weight configurations for BDN model weight distribution

Example:
bdn
Bdn · object | null

BDN configuration for read-only sealed volume mounts; supports mounts only

egress_restrictions
EgressRestrictionsV1 · object | null

Restricts this deployment's egress to the specified FQDNs and IP addresses; an empty block allows none. Requires the organization to have egress restrictions enabled.

runtime
LLMRuntimeV1 · object | null

Runtime configuration for the deployment

Response

200 - application/json

Handle for a BIS-LLM model deployment.

model_id
string
required

Unique identifier of the model

version_id
string
required

Unique identifier of the model version

hostname
string
required

Hostname used to invoke the model

instance_type_name
string | null

Name of the instance type the model deployment is running on