- Control plane: Manages your models, handling builds, scheduling, and lifecycle.
- Workload plane: Routes inference requests and runs model replicas on GPUs.
Hosting option comparison
Choose Baseten Cloud unless an infrastructure, isolation, or networking requirement rules it out. Choose single-tenant when you need dedicated isolation or private connectivity without operating infrastructure in your own account. Choose self-hosted when inference must run in infrastructure you control.
Hybrid hosting
Hybrid combines self-hosted workload planes with Baseten Cloud. Use it when requirements differ across workloads and you want to place each workload in the appropriate environment. Hybrid extends self-hosted rather than replacing it as a separate infrastructure model.Next steps
- To deploy on Baseten Cloud, sign up and follow the quickstart guide.
- To scope single-tenant, self-hosted, or hybrid hosting, talk to us.