Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.

Skip to main content

Assistant

Responses are generated using AI and may contain mistakes.

Suggestions

Baseten home page

Examples

Overview
Deploy your first model
Deploy a model

Models

Overview

Engines

Deploy LLMs with TensorRT-LLM
Serve embeddings with BEI
Deploy a model with Eagle speculative decoding

Custom Docker servers

Deploy a Hugging Face model
Deploy LLMs with vLLM
Deploy LLMs with SGLang
Deploy LLMs with Ollama
Deploy a Dockerized model

Custom Python models

Build and deploy an LLM
Customize a model
Generate images with Flux
Generate speech with Kokoro
Stream LLM responses
Add system packages

Chains

Build a RAG pipeline with Chains
Transcribe audio with Chains

Baseten for Model Labs

Deploy a Model Labs listing

Support
Return to Baseten

Baseten home page

Support
Return to Baseten
Return to Baseten

Cross-encoder models

Cross-encoder models that score query-document pairs jointly.

Embedding

Qwen3 Reranker

Deploy Qwen3 Reranker with a prebuilt Truss config.

zerank

Deploy zerank with a prebuilt Truss config.

Was this page helpful?

⌘I

Back to top

Embedding

Baseten home page

github linkedin x

Return to Baseten Changelog Support Status

github linkedin x

github linkedin x