GPT-OSS 20B vs GPT-OSS 120B on Groq
GPT-OSS 20B is an open-weight chat model you can call on this endpoint; GPT-OSS 120B on Groq is offered from Groq. Below: what each costs for three realistic workloads, the limits that apply, and when to choose which.
Groq figures are public list prices and documented limits, checked 2026-09-16 against the provider page. Inference APIs prices are read live from the price list.
- Cost: GPT-OSS 20B is cheaper in all three workloads, by 74–75%.
- Limits: Groq: Free tier: 30 requests/min, 1,000 requests/day, 8,000 tokens/min, 200,000 tokens/day. Developer-tier upgrades were paused when we checked (Sep 2026). Here: no per-minute or per-day caps.
Side by side
| GPT-OSS 20B | GPT-OSS 120B on Groq | |
|---|---|---|
| Served by | Inference APIs | Groq |
| Model author | OpenAI | OpenAI |
| Model id | openai/gpt-oss-20b | openai/gpt-oss-120b |
| Input price | $0.04 / 1M tokens | $0.15 / 1M tokens |
| Output price | $0.19 / 1M tokens | $0.75 / 1M tokens |
| Context window | 131K tokens | 131K tokens |
| Capabilities | Chat, Reasoning, Tool calling, JSON mode | Chat, Reasoning, Tool calling, JSON mode |
| Weights | Open | Open |
| Status | Available | Available |
| Limits | No per-minute or per-day request or token caps; usage draws on a prepaid balance | Free tier: 30 requests/min, 1,000 requests/day, 8,000 tokens/min, 200,000 tokens/day. Developer-tier upgrades were paused when we checked (Sep 2026). |
What three workloads cost
List prices applied to the same work. The cheaper side of each row is in bold.
| Workload | GPT-OSS 20B | GPT-OSS 120B on Groq | Difference |
|---|---|---|---|
| Chat assistant — 10,000 turns of 800 tokens in, 300 out | $0.89 | $3.45 | 74% |
| Long prompts or RAG — 10,000 requests of 8,000 in, 500 out | $4.15 | $15.75 | 74% |
| Generation-heavy — 10,000 requests of 500 in, 2,000 out | $4.00 | $15.75 | 75% |
GPT-OSS 20B is cheaper in all three workloads, by 74–75%. Reasoning models bill their thinking as output tokens, so real output counts run higher than the visible answer; treat the generation-heavy row as a floor for them.
When to choose which
- Cost is the deciding factor; it is cheaper in every workload above
- You are replacing llama-3.1-8b-instant on Groq and want the small model Groq itself recommends
- Classification, extraction and short assistant replies where cost per call matters more than depth
- You have outgrown the free tier and cannot upgrade
- Your volume fits the free tier, or you already have a Developer-tier account
- Raw output speed is the priority; Groq's hardware is built for it
Price, context and speed are measurable; answer quality on your task is not something a table can settle. Both take the same request, so the honest test is to run your own prompts through each.
Switching from Groq
Both speak the OpenAI wire format. The edit is the base URL, the key and the model id; then re-run your own prompts, because it is a different model.
import os
from openai import OpenAI
# before: Groq
# client = OpenAI(base_url="https://api.groq.com/openai/v1", api_key=os.environ["GROQ_API_KEY"])
# MODEL = "openai/gpt-oss-120b"
# after: Inference APIs
client = OpenAI(base_url="https://api.inferenceapis.com/v1", api_key=os.environ["INFERENCE_API_KEY"])
MODEL = "openai/gpt-oss-20b"
resp = client.chat.completions.create(model=MODEL, messages=[{"role": "user", "content": "Hello"}], max_tokens=500)More detail, including Node, LangChain and LiteLLM: switching OpenAI-compatible providers.
FAQ
Which is cheaper, GPT-OSS 20B or GPT-OSS 120B on Groq?
GPT-OSS 20B is cheaper in all three workloads, by 74–75%. The table above uses list prices: GPT-OSS 20B $0.04 / 1M tokens input, $0.19 / 1M tokens output; GPT-OSS 120B on Groq $0.15 / 1M tokens input, $0.75 / 1M tokens output.
Can I switch from GPT-OSS 120B on Groq to GPT-OSS 20B without rewriting code?
Yes, if you call it through an OpenAI-compatible client. Change the base URL to https://api.inferenceapis.com/v1, swap the API key, and set the model to openai/gpt-oss-20b. Because it is a different model, re-run your prompts and evaluations before moving production traffic.
What limits apply to GPT-OSS 120B on Groq?
Free tier: 30 requests/min, 1,000 requests/day, 8,000 tokens/min, 200,000 tokens/day. Developer-tier upgrades were paused when we checked (Sep 2026). On Inference APIs there are no per-minute or per-day request or token caps; usage draws on a prepaid balance.
Why does GPT-OSS 20B use more output tokens than the visible answer?
It is a reasoning model: it thinks before it answers and the thinking is billed as output tokens. Budget for that in output-heavy workloads, and set max_tokens to a few hundred or more so the answer is not cut off.
Spotted a price or limit that has changed? Tell us and we will re-check the provider page.