Choose who can access your model
Allowlisted Model API access limits the activation handoff to the customer workspaces you select. For broad Model API availability, complete validation and assisted setup with Baseten, then send the activation handoff to each customer workspace. For Dedicated availability, Baseten configures customer availability during assisted setup.Give customers access to a Model API
Each Model API has an activation URL with this format:<SharedEndpointId> value identifies the Model API. The URL activates the
model only in the workspace whose admin accepts the terms.
To share a customer activation link:
- Copy the activation URL provided by Baseten.
- Send the URL unchanged to an admin of the customer’s Baseten workspace.
- Sign in to your workspace at app.baseten.co.
- Open the activation URL shared by the model provider.
- On Add <model name>, review the model details.
- Under Information shared with <provider>, choose I agree to share this information with <provider>.
- Under Terms and agreements, choose Review agreement.
- If the provider supplies a terms URL, choose Review terms.
- Choose I have read and agreed to <provider>‘s model terms. If the provider doesn’t supply a terms URL, choose I agree to <provider>‘s model terms instead.
- Choose Next: Add Model API.
Give customers access to a Dedicated model
Baseten configures Dedicated customer availability during assisted setup. Dedicated models do not use activation URLs. Each customer deployment remains pinned to the version the customer adopts.Set Model API rate limits
Distribution Model APIs support per-customer requests-per-minute (RPM) and tokens-per-minute (TPM) limits. Manage these limits in the console. Baseten doesn’t expose a supported public API for this operation. To set RPM and TPM limits:- Sign in to your workspace at app.baseten.co.
- Choose Insights under Labs in the sidebar.
- In the Customers table, choose the customer row.
- Under Model APIs, choose the ⋯ menu for the Model API.
- Choose Edit limits.
- For Requests per minute, type the RPM limit.
- For Tokens per minute, type the TPM limit.
- Choose Save.