Inference APIs
Compare/Chat

GPT-OSS 20B vs Llama 3.3 70B Instruct

Two chat models compared on price, context, capabilities and measured speed. External prices are public list rates verified 2026-09-16; Inference APIs prices are live.

GPT-OSS 20BLlama 3.3 70B Instruct
ProviderOpenAIMeta
Model idopenai/gpt-oss-20bmeta-llama/Llama-3.3-70B-Instruct-Turbo
Input price$0.07 / 1M tokens$1.35 / 1M tokens
Output price$0.27 / 1M tokens$1.35 / 1M tokens
Context window131K tokens131K tokens
CapabilitiesChat, Reasoning, Tool callingChat, Tool calling, JSON mode, Multilingual
WeightsOpenOpen
AvailabilityComing soonAvailable on Inference APIs
Rate limitsNo daily caps; pay per requestNo daily caps; pay per request
Time to first tokennot measured1.29 s
Output speednot measured67.5 tokens / s

Cost for 1M input + 1M output tokens

GPT-OSS 20B
$0.34
Llama 3.3 70B Instruct
$2.7

GPT-OSS 20B is about 87% cheaper for this workload at list price.

Measured speed

Speed figures for Inference APIs models are medians of three runs from a European client on 2026-09-16, against the public endpoint, using a ~120-word generation prompt (chat), a 300-character paragraph (speech) or a -second clip (transcription). External models are not measured here; treat "not measured" as unknown, not slow.

When to pick which

  • GPT-OSS 20B — The small GPT-OSS model: fast and inexpensive for lightweight assistants and classification.
  • Llama 3.3 70B Instruct — Meta's instruction-tuned 70B model. Still served here after its retirement on Groq — the same llama-3.3-70b-versatile id works unchanged.

Try GPT-OSS 20B

Same OpenAI request shape; the change is the base URL and key. Full parameters, aliases and pricing on the model page.

curl https://api.inferenceapis.com/v1/chat/completions \
  -H "Authorization: Bearer $INFERENCE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "openai/gpt-oss-20b",
    "messages": [
      {"role": "system", "content": "You are a helpful assistant."},
      {"role": "user", "content": "Hello! What can you do?"}
    ]
  }'
import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.inferenceapis.com/v1",
    api_key=os.environ["INFERENCE_API_KEY"],
)
response = client.chat.completions.create(
    model="openai/gpt-oss-20b",
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "Hello! What can you do?"},
    ],
)
print(response.choices[0].message.content)
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.inferenceapis.com/v1",
  apiKey: process.env.INFERENCE_API_KEY,
});
const response = await client.chat.completions.create({
  model: "openai/gpt-oss-20b",
  messages: [
    { role: "system", content: "You are a helpful assistant." },
    { role: "user", content: "Hello! What can you do?" },
  ],
});
console.log(response.choices[0].message.content);

External prices and limits come from the linked provider pages and were verified on 2026-09-16. Spotted a change? Tell us.