Skip to main content
Model APIs support text and vision inputs, but multimodal capability depends on the underlying model. Vision-capable models accept images alongside text in the same request, using the OpenAI-compatible image_url content type. The model processes both modalities together, so it can answer questions about image content, compare multiple images, or extract structured data from screenshots. Not all models support vision. Check the table below before sending image inputs.

Supported models

Nemotron 3.5 Super VL accepts text and image inputs. Audio and video inputs aren’t supported through its Model API.

Send a vision request

Use the image_url content type to include images in your messages. Baseten retrieves image URLs from the inference service, so the URL must be reachable over HTTPS from Baseten’s environment (for example your own object storage, Hugging Face artifact links, or other hosts that allow server-side fetches). Prefer stable, direct HTTPS links. Optional image_url.detail controls preprocessing resolution: low, high, original, or auto (OpenAI-compatible). When in doubt, use auto. Send an image alongside a text prompt like this:
vision.py

Image and video limits

Baseten’s media encoder enforces the following per-request limits: Pass media by URL whenever you can. The vision encoder fetches each URL and enforces the per-file and total-media caps directly, while the request body stays small. Base64-encoded media travels inside the request body and counts toward the model’s request-body limit. Muse Spark Open accepts JPEG, PNG, WebP, GIF, BMP, and TIFF images. For animated GIFs, it uses only the first frame. It accepts MP4, MOV, MKV, and WebM videos with H.264, H.265, VP9, or AV1 encoding, up to 4K at 60 frames per second. It samples at most 96 frames per video and ignores the audio track. Send speech as a separate audio_url part. Muse Spark Open enforces a 200 MB combined limit for images, videos, and audio, plus a 896 MiB encoded-media budget per request. A request can fit within the file-size limits and still exceed the encoded-media budget. Combining 8 large images, 2 five-minute videos, and 4 five-minute audio files can return HTTP 400. Split large combinations across requests. Send files larger than about 75 MB by URL. Base64 encoding increases their size by about a third, and the complete request must fit within the 100 MiB request-body limit. Muse Spark Open doesn’t accept PDF files. Extract their text before sending it.

Pricing

There is no additional per-image fee. Images are converted to input tokens and priced at the model’s standard input rate. Higher resolution images produce more tokens and cost more to process. The exact conversion from pixels to tokens depends on the model. Kimi K3 divides each image into 28×28 pixel tiles where each tile becomes one input token. The cost table below uses Kimi K3’s uncached input rate ($3.00 per million tokens); for other models, use the rates on the Model APIs pricing page. For videos, token count scales with both resolution and the number of sampled frames.

Next steps

Model APIs overview

Supported models, pricing, and the feature support matrix

Chat Completions reference

Full request and response schema for the image_url content type