Inference APIs

Chat

Text generation, reasoning, assistants and agents

GPT-OSS 120B

Available Popular
by OpenAI

OpenAI's open-weight 120B reasoning model. Strong at coding, tool use and agentic tasks; the drop-in replacement Groq recommends for Llama 3.3 70B.

ChatReasoningTool callingJSON mode131K context
Context
131K tokens
Modality
Text → Text
Input
$0.20 / 1M tokens
Output
$0.80 / 1M tokens
Model ID
openai/gpt-oss-120b

DeepSeek V4 Flash

Available Best value
by DeepSeek

DeepSeek's fast, inexpensive V4 model with a 1M-token context. Strong general assistant and coding model at the lowest price per token here.

ChatReasoningCodingTool calling1M context
Context
1M tokens
Modality
Text → Text
Input
$0.19 / 1M tokens
Cached input
$0.04 / 1M tokens
Output
$0.38 / 1M tokens
Model ID
deepseek-ai/DeepSeek-V4-Flash

The newest DeepSeek Flash model: much quicker to answer than V4 Flash in our measurements, with a 1M-token context.

ChatReasoningTool callingJSON mode1M context
Context
1M tokens
Modality
Text → Text
Input
$0.40 / 1M tokens
Cached input
$0.01 / 1M tokens
Output
$1.60 / 1M tokens
Model ID
deepseek-ai/DeepSeek-V4.1-Flash

Z.ai's fast GLM 5.3 model with tool calling, JSON mode and a 1M-token context, at a low per-token price.

ChatReasoningTool callingJSON mode1M context
Context
1M tokens
Modality
Text → Text
Input
$0.20 / 1M tokens
Cached input
$0.04 / 1M tokens
Output
$0.66 / 1M tokens
Model ID
zai-org/GLM-5.3-Flash

Meta's instruction-tuned 70B model. Still served here after its retirement on Groq — the same llama-3.3-70b-versatile id works unchanged.

ChatTool callingJSON modeMultilingual
Context
131K tokens
Modality
Text → Text
Input
$0.20 / 1M tokens
Output
$0.50 / 1M tokens
Model ID
meta-llama/Llama-3.3-70B-Instruct-Turbo

GLM 5.3

Available
by Z.ai

Z.ai's full-size GLM 5.3 model: tool calling, JSON-schema output and a 1M-token context, for coding agents and long tasks.

ChatReasoningTool callingJSON mode1M context
Context
1M tokens
Modality
Text → Text
Input
$1.82 / 1M tokens
Cached input
$0.34 / 1M tokens
Output
$5.72 / 1M tokens
Model ID
zai-org/GLM-5.3

DeepSeek's largest V4 model (0813 release) with a 1M-token context, hosted in the United States.

ChatReasoningCodingTool callingJSON mode1M context
Context
1M tokens
Modality
Text → Text
Input
$1.72 / 1M tokens
Cached input
$0.17 / 1M tokens
Output
$5.15 / 1M tokens
Model ID
deepseek-ai/DeepSeek-V4-Pro

MiniMax M3

Available
by MiniMax

MiniMax's M3 model: tool calling and a 512K-token context at a price close to the Flash tier.

ChatReasoningTool callingJSON mode512K context
Context
512K tokens
Modality
Text → Text
Input
$0.39 / 1M tokens
Cached input
$0.08 / 1M tokens
Output
$1.56 / 1M tokens
Model ID
MiniMaxAI/MiniMax-M3

Kimi K2.7 Code

Available
by Moonshot AI

Moonshot AI's coding-tuned Kimi model with a 262K-token context, for coding agents and IDE assistants.

ChatReasoningCodingTool calling262K context
Context
262K tokens
Modality
Text → Text
Input
$0.89 / 1M tokens
Cached input
$0.18 / 1M tokens
Output
$4.42 / 1M tokens
Model ID
moonshotai/Kimi-K2.7-Code

GPT-OSS 20B

Available Cheapest
by OpenAI

OpenAI's small open-weight reasoning model: the cheapest chat model here, for lightweight assistants, classification and extraction.

ChatReasoningTool callingJSON mode131K context
Context
131K tokens
Modality
Text → Text
Input
$0.04 / 1M tokens
Output
$0.19 / 1M tokens
Model ID
openai/gpt-oss-20b

Qwen3.8 Flash

Available
by Alibaba Qwen

Alibaba's fast Qwen3.8 model with a one-million-token context window and cached-input pricing.

ChatReasoningTool callingJSON mode1M contextCached input
Context
1M tokens
Modality
Text → Text
Input
$0.15 / 1M tokens
Cached input
$0.02 / 1M tokens
Output
$0.50 / 1M tokens
Model ID
Qwen/Qwen3.8-Flash

Qwen3-VL 235B

Available Vision
by Alibaba Qwen

Alibaba's large vision-language model: send images in a chat request for OCR, document extraction and screenshot reasoning.

VisionOCRChatTool callingJSON mode262K context
Context
262K tokens
Modality
Image + Text → Text
Input
$0.26 / 1M tokens
Output
$1.15 / 1M tokens
Model ID
Qwen/Qwen3-VL-235B-A22B-Instruct

Text to speech

Natural voices on the OpenAI /v1/audio/speech endpoint

Kokoro 82M

Available Popular
by Hexgrad

Fast, natural open-weight text-to-speech with 54 voices across 8 languages, on the OpenAI /v1/audio/speech endpoint.

Text to speech54 voicesMP3 / WAV8 languages
Modality
Text → Audio
Price
$5.20 / 1M characters
Model ID
hexgrad/Kokoro-82M

Orpheus 3B

Available
by Canopy Labs

Expressive Llama-based text-to-speech with emotive tags and eight English voices.

Text to speechExpressive8 voicesEnglish
Modality
Text → Audio
Price
$19.50 / 1M characters
Model ID
canopylabs/orpheus-3b-0.1-ft

Speech to text

Transcription with timestamps on /v1/audio/transcriptions

Whisper Large v3

Available Popular
by OpenAI

OpenAI's multilingual speech recognition model on the standard /v1/audio/transcriptions endpoint — same request shape as OpenAI and Groq.

Speech to text100 languagesWord timestampsSpeaker diarizationSRT / VTT
Modality
Audio → Text
Price
$0.002 / audio minute
Model ID
openai/whisper-large-v3

Parakeet TDT 0.6B v3

Available Fastest
by NVIDIA

NVIDIA's very fast English-first transcription model with accurate timestamps; ideal for long recordings and batch jobs.

Speech to textVery fastTimestamps25 languages
Modality
Audio → Text
Price
$0.002 / audio minute
Model ID
nvidia/parakeet-tdt-0.6b-v3

Voxtral Small 24B

Available New
by Mistral AI

Mistral's 24B speech model as a transcription endpoint: eight languages with automatic detection, strong on accented and noisy audio.

Speech to text8 languagesAuto languageText only
Modality
Audio → Text
Price
$0.004 / audio minute
Model ID
mistralai/Voxtral-Small-24B-2507

Voxtral Mini 3B

Available Cheapest
by Mistral AI

Mistral's small Voxtral model: the lowest price per minute here, eight languages with automatic detection.

Speech to text8 languagesAuto languageLowest price
Modality
Audio → Text
Price
$0.0013 / audio minute
Model ID
mistralai/Voxtral-Mini-3B-2507

Embeddings

Text vectors for search and RAG on the OpenAI /v1/embeddings endpoint

BGE-M3

Available Popular
by BAAI

BAAI's multilingual embedding model: 1,024-dimension vectors, 8K-token inputs, on the OpenAI /v1/embeddings endpoint.

EmbeddingsMultilingual1,024 dimensions8K input
Context
8K tokens
Modality
Text → Vector
Price
$0.02 / 1M input tokens
Model ID
BAAI/bge-m3

Qwen3 Embedding 8B

Available
by Alibaba Qwen

Qwen's 8B embedding model: up to 4,096 dimensions with adjustable size, 32K-token inputs, multilingual.

EmbeddingsMultilingualAdjustable dimensions32K input
Context
32K tokens
Modality
Text → Vector
Price
$0.02 / 1M input tokens
Model ID
Qwen/Qwen3-Embedding-8B

Rerank

Score passages against a query on /v1/rerank

Qwen3 Reranker 8B

Available
by Alibaba Qwen

Qwen's 8B reranker: scores passages against a query so RAG pipelines keep the right context.

RerankMultilingual32K input
Context
32K tokens
Modality
Query + Texts → Scores
Price
$0.07 / 1M input tokens
Model ID
Qwen/Qwen3-Reranker-8B

Vision

Image understanding and screen parsing

OmniParser V2

Unavailable
by Microsoft

Parse screenshots into structured, labeled UI elements for computer-use agents.

VisionUI element detectionOCR
Modality
Image → Structured data
Price
$0.003 / request
Model ID
omniparser2