image_url content type. The model processes both modalities together, so it can answer questions about image content, compare multiple images, or extract structured data from screenshots.
Not all models support vision. Check the table below before sending image inputs.
Supported models
Nemotron 3.5 Super VL accepts text and image inputs. Audio and video inputs aren’t supported through its Model API.
Send a vision request
Use theimage_url content type to include images in your messages.
Baseten retrieves image URLs from the inference service, so the URL must be reachable over HTTPS from Baseten’s environment (for example your own object storage, Hugging Face artifact links, or other hosts that allow server-side fetches). Prefer stable, direct HTTPS links.
Optional image_url.detail controls preprocessing resolution: low, high, original, or auto (OpenAI-compatible). When in doubt, use auto. Send an image alongside a text prompt like this:
- Python
- JavaScript
- cURL
vision.py
Image and video limits
Baseten’s media encoder enforces the following per-request limits:
Pass media by URL whenever you can. The vision encoder fetches each URL and enforces the per-file and total-media caps directly, while the request body stays small. Base64-encoded media travels inside the request body and counts toward the model’s request-body limit.
Muse Spark Open accepts JPEG, PNG, WebP, GIF, BMP, and TIFF images. For animated GIFs, it uses only the first frame. It accepts MP4, MOV, MKV, and WebM videos with H.264, H.265, VP9, or AV1 encoding, up to 4K at 60 frames per second. It samples at most 96 frames per video and ignores the audio track. Send speech as a separate
audio_url part.
Muse Spark Open enforces a 200 MB combined limit for images, videos, and audio, plus a 896 MiB encoded-media budget per request. A request can fit within the file-size limits and still exceed the encoded-media budget. Combining 8 large images, 2 five-minute videos, and 4 five-minute audio files can return HTTP 400. Split large combinations across requests.
Send files larger than about 75 MB by URL. Base64 encoding increases their size by about a third, and the complete request must fit within the 100 MiB request-body limit.
Muse Spark Open doesn’t accept PDF files. Extract their text before sending it.
Pricing
There is no additional per-image fee. Images are converted to input tokens and priced at the model’s standard input rate. Higher resolution images produce more tokens and cost more to process. The exact conversion from pixels to tokens depends on the model. Kimi K3 divides each image into 28×28 pixel tiles where each tile becomes one input token. The cost table below uses Kimi K3’s uncached input rate ($3.00 per million tokens); for other models, use the rates on the Model APIs pricing page.
For videos, token count scales with both resolution and the number of sampled frames.
Next steps
Model APIs overview
Supported models, pricing, and the feature support matrix
Chat Completions reference
Full request and response schema for the
image_url content type