Skip to main content
Set up Grid once per team: add its members, choose the models it can use, and set its spend limits. When you finish, developers on the team can run baseten grid setup and see the team’s models in their coding agent. Manage Grid from the Grid page in the Baseten app. Use Activity and Users to review usage. Choose a team on Routes, Connections, or Guardrails to manage its models, provider keys, or budgets. You can also manage routes, provider connections, and team settings with the Baseten CLI, or manage every setting with the Management API.

Before you begin

  • Baseten has enabled Grid for your organization. To request access, Contact us.
  • You’re an organization Admin, or an Admin of each team you set up. Team members can use a team’s routes but can’t change them.
  • To use Anthropic, OpenAI, or xAI models, you have an API key from that provider. See Choose a provider API key.
For the CLI procedures, install the Baseten CLI and sign in to your organization.

Credentials and ownership

Grid uses different credentials for administration, coding agents, and upstream model providers: Use an authorized Baseten API key for Management API operations. It is separate from the inference-only provider key you add in Connections.

Organize teams and members

Grid uses your organization’s teams. Each team has its own routes, provider connections, harness defaults, and spend limits. Create a team for each group of developers that needs different models or a different budget, such as an infrastructure team with frontier models and a $10,000 team-wide limit, and a go-to-market team with open-weight models only. Invite developers to a team, or sync team membership from your identity provider with SCIM. A developer on several teams picks one with --team when they run setup.

Connect model providers

Skip this step if the team uses only Baseten Model APIs. Connecting a provider supplies its credential; you still need to add its models to the team.
To connect a model provider:
  1. Sign in to your workspace at app.baseten.co and choose Grid in the sidebar.
  2. Choose Connections.
  3. Choose the team from the dropdown.
  4. Choose Connect for the provider.
  5. Enter a provider API key restricted to inference, then save. See Choose a provider API key.
Confirm that the provider appears as connected for the team.To replace an existing key, choose the provider’s edit icon.
Baseten stores the key as a secret on the team and never shows it again. The provider bills its own usage to that key. To rotate the key, edit the connection; every route that uses the connection switches to the new key.

Choose a provider API key

Give Grid a key that can run inference but can’t administer your provider account. A service account key isn’t automatically restricted to inference. Check both the account’s permissions and the key’s scope before you add it. For key creation and permissions, see the Anthropic authentication guide, OpenAI project API key guide, and xAI API key permissions.

Choose team models

Add the models a team’s developers can pick in their coding agent. Mix open-weight models from Model APIs with frontier models from a connected provider, so developers can use a frontier model for the hardest problems and an open-weight model for routine work without leaving their agent.
To add models to a team:
  1. Sign in to your workspace at app.baseten.co and choose Grid in the sidebar.
  2. Choose Routes.
  3. Choose the team from the dropdown.
  4. Choose Add routes.
  5. Choose Model APIs or a connected provider.
  6. Add each model that the team should be able to call.
Confirm that the new models appear in the team’s routes.
Grid lists a model in a coding agent only when the agent can call the model’s API and the model supports tool calling. See Model requirements.

Add an auto route

An auto route lets a classifier choose among several direct routes for each request. The default route handles a request when the classifier doesn’t choose one. Auto routes can’t contain other auto routes. Add the direct routes the classifier can choose before creating the auto route.
To add an auto route:
  1. Sign in to your workspace at app.baseten.co and choose Grid in the sidebar.
  2. Choose Routes.
  3. Choose the team from the dropdown.
  4. Choose Add routes.
  5. Choose Intelligent routing.
  6. Enter the route’s display name.
  7. Choose the allowed routes and a default route from that set.
  8. Choose an available classifier.
  9. Choose Add intelligent route.
Confirm that the auto route appears in the team’s routes with the intended classifier and allowed models.
Developers can select the auto route in their coding agent like any other compatible team route.

Set harness defaults

Set harness defaults to choose the model each coding agent uses when a developer runs setup without picking one. Claude Code and OpenCode have a primary model and a background model for lightweight tasks; Codex and Pi have a primary model only. To pair a frontier model with a cheaper one, set a frontier route as the primary model and an open-weight Model API as the background model. Developers get the frontier model for their main work, while lightweight background requests go to the open-weight model. Without an override, Baseten recommends routes from the team’s LLM Model APIs. It recommends the highest-ranked Model API for primary work and the least expensive Model API for background work. Connected-provider routes aren’t automatic recommendations, but you can select a compatible provider route as an override.
To choose a coding agent’s default models:
  1. Sign in to your workspace at app.baseten.co and choose Grid in the sidebar.
  2. Choose Routes.
  3. Choose the team from the dropdown.
  4. Under Harness model overrides, expand Harness overrides.
  5. For Default, choose the primary route for the coding agent.
  6. For Background, where available, choose the route for lightweight tasks.
  7. Choose Save changes.
Confirm that the selected routes remain in the team’s harness overrides.
Only the defaults you provide change. Developers who use team defaults pick up the changes when they next run setup or sync. Explicit route choices take precedence over team defaults.

Set spend limits

Set a per-member limit for the team, a team-wide limit, or both. See Set spend limits and view usage for how limits combine and how to change one developer’s limit.

Verify the team is ready

Before inviting the whole team to connect, have one member complete developer setup and send a test request. Confirm that:
  • The intended team models appear in the coding agent’s model picker.
  • The selected model returns a response.
  • Existing MCP tools still work if the team relies on them.
  • Usage appears for that developer after the metering delay, which can be up to 15 minutes.

Roll out to developers

Once the pilot works, use Roll out Grid to developers for an announcement template and scripted setup options.