Inference APIs
OpenAI-compatible · chat, speech, transcription

Run popular AI models with one simple API.

Chat, text-to-speech and transcription on one OpenAI-compatible endpoint — GPT-OSS 120B, DeepSeek V4 Flash, Kokoro, Whisper and more. Pay per request, no tiers, no daily caps.

Fast to integrate

Familiar chat completions format. Send a request with cURL, Python or JavaScript in minutes.

Pay as you go

Prepaid credits with no subscription or minimums. Every new account starts with free credit.

No infrastructure

We handle hosting, scaling and model updates so you can focus on your product.

Models

View all
GPT-OSS 120B
Text → Text · 131K context
Available

OpenAI's open-weight 120B reasoning model. Strong at coding, tool use and agentic tasks; the drop-in replacement Groq recommends for Llama 3.3 70B.

DeepSeek V4 Flash
Text → Text · 1M context
Available

DeepSeek's fast, inexpensive V4 model with a 1M-token context. Strong general assistant and coding model at the lowest price per token here.

DeepSeek V4.1 Flash
Text → Text · 1M context
Available

The newest DeepSeek Flash model: better reasoning and tool use than V4 Flash, still with a 1M-token context.

GLM 5.3 Flash
Text → Text · 1M context
Available

Z.ai's fast GLM 5.3 model with tool calling, JSON mode and a 1M-token context, at a low per-token price.

Llama 3.3 70B Instruct
Text → Text · 131K context
Available

Meta's instruction-tuned 70B model. Still served here after its retirement on Groq — the same <code>llama-3.3-70b-versatile</code> id works unchanged.

GPT-OSS 20B
Text → Text · 131K context
Coming soon

The small GPT-OSS model: fast and inexpensive for lightweight assistants and classification.

Qwen3-VL 8B
Image + Text → Text · 262K context
Coming soon

Compact vision-language model for image understanding, OCR and screenshot reasoning.

Kokoro 82M
Text → Audio
Available

Fast, natural open-weight text-to-speech with 54 voices across 8 languages, on the OpenAI <code>/v1/audio/speech</code> endpoint.

Orpheus 3B
Text → Audio
Available

Expressive Llama-based text-to-speech with emotive tags and eight English voices.

Whisper Large v3
Audio → Text
Available

OpenAI's multilingual speech recognition model on the standard <code>/v1/audio/transcriptions</code> endpoint — same request shape as OpenAI and Groq.

Parakeet TDT 0.6B v3
Audio → Text
Available

NVIDIA's very fast English-first transcription model with accurate timestamps; ideal for long recordings and batch jobs.

OmniParser V2
Image → Structured data
Unavailable

Parse screenshots into structured, labeled UI elements for computer-use agents.

Quickstart

Create an account and get your API key

Sign up for free. Your key is ready immediately on the API Keys page.

Make your first request
curl https://api.inferenceapis.com/v1/chat/completions \
  -H "Authorization: Bearer $INFERENCE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/Llama-3.3-70B-Instruct-Turbo",
    "messages": [
      {"role": "system", "content": "You are a helpful assistant."},
      {"role": "user", "content": "Hello! What can you do?"}
    ]
  }'
import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.inferenceapis.com/v1",
    api_key=os.environ["INFERENCE_API_KEY"],
)
response = client.chat.completions.create(
    model="meta-llama/Llama-3.3-70B-Instruct-Turbo",
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "Hello! What can you do?"},
    ],
)
print(response.choices[0].message.content)
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.inferenceapis.com/v1",
  apiKey: process.env.INFERENCE_API_KEY,
});
const response = await client.chat.completions.create({
  model: "meta-llama/Llama-3.3-70B-Instruct-Turbo",
  messages: [
    { role: "system", content: "You are a helpful assistant." },
    { role: "user", content: "Hello! What can you do?" },
  ],
});
console.log(response.choices[0].message.content);
Explore

Tune prompts in the playground, browse the model catalog, or read the API reference.