GPT-OSS 120B API
Available PopularGPT-OSS 120B is OpenAI's open-weight mixture-of-experts model (117B parameters, 5.1B active). It reasons before answering, supports tool calling and structured output, and is the model Groq points users to as the replacement for Llama 3.3 70B. Serve it here with pay-per-request billing and no daily cap.
ChatReasoningTool callingJSON mode131K context
Context window
131K tokens
Modality
Text → Text
Input
$0.20 / 1M tokens
Output
$0.80 / 1M tokens
Time to first token
0.93 s
Output speed
132.9 tok/s
Model ID
openai/gpt-oss-120b
Quickstart
You need an API key to call this model. Create a free account or log in.
Set INFERENCE_API_KEY to your key from the API Keys page, then run:
curl https://api.inferenceapis.com/v1/chat/completions \
-H "Authorization: Bearer $INFERENCE_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "openai/gpt-oss-120b",
"messages": [
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Hello! What can you do?"}
]
}'
import os
from openai import OpenAI
client = OpenAI(
base_url="https://api.inferenceapis.com/v1",
api_key=os.environ["INFERENCE_API_KEY"],
)
response = client.chat.completions.create(
model="openai/gpt-oss-120b",
messages=[
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Hello! What can you do?"},
],
)
print(response.choices[0].message.content)
import OpenAI from "openai";
const client = new OpenAI({
baseURL: "https://api.inferenceapis.com/v1",
apiKey: process.env.INFERENCE_API_KEY,
});
const response = await client.chat.completions.create({
model: "openai/gpt-oss-120b",
messages: [
{ role: "system", content: "You are a helpful assistant." },
{ role: "user", content: "Hello! What can you do?" },
],
});
console.log(response.choices[0].message.content);
Endpoint
POST
https://api.inferenceapis.com/v1/chat/completions
Headers
Authorization: Bearer $INFERENCE_API_KEY
Content-Type: application/json
Content-Type: application/json
Compatible
OpenAI wire format.
/openai/v1/… is accepted too, so Groq-style base URLs work with only the host changed.
Model IDs and aliases
Send any of these as model; they all resolve to this model.
| ID | Note |
|---|---|
openai/gpt-oss-120b | Canonical |
gpt-oss-120b | Alias |
Request body
| Parameter | Type | Description |
|---|---|---|
model required |
string | Model ID: openai/gpt-oss-120b — also accepted: gpt-oss-120b |
messages required |
array | Conversation so far. Each item has a role (system, user or assistant) and content. |
max_tokens |
integer | Maximum number of tokens to generate (includes reasoning tokens — use a few hundred or more). |
temperature |
number | Sampling temperature. Higher values give more varied output. |
top_p |
number | Nucleus sampling cutoff. |
stream |
boolean | Stream the response as server-sent events. The final chunk includes usage. |
tools |
array | Tool definitions for function calling (OpenAI format). |
response_format |
object | {"type": "json_object"} for JSON mode. |
stop |
string | array | Sequences where the model stops generating. |
seed |
integer | Seed for more reproducible sampling. |
Response
200 OK · application/json
{
"id": "chatcmpl-abc123",
"object": "chat.completion",
"model": "openai/gpt-oss-120b",
"choices": [
{
"index": 0,
"message": {
"role": "assistant",
"content": "Hi! I can answer questions, write and edit text, help with code and more.",
"reasoning": "The user is greeting me and asking about capabilities..."
},
"finish_reason": "stop"
}
],
"usage": { "prompt_tokens": 28, "completion_tokens": 17, "total_tokens": 45 }
}
Pricing
| Input | $0.20 / 1M tokens |
| Output | $0.80 / 1M tokens |
| Billing | Pay as you go from prepaid credits. No subscription, no daily request or token cap. See all pricing. |
Notes
- This is a reasoning model: it spends tokens thinking before it answers. Set
max_tokensto at least a few hundred or the reply can come back empty with only thereasoningfield populated. - The response includes a
reasoningfield alongsidecontent;usage.completion_tokens_details.reasoning_tokensreports how many tokens were spent thinking.
Compare GPT-OSS 120B with…
Errors
Errors use the OpenAI envelope: {"error": {"message", "type", "code"}}. 401 missing or invalid key · 402 insufficient_balance · 404 model_not_found · 503 model_unavailable. See the error reference and provider error guides.
