Inference APIs
Company

Changelog

Every user-visible change, newest first. RSS

2026-09-16 model
New chat models: GPT-OSS 120B, DeepSeek V4 Flash, DeepSeek V4.1 Flash, GLM 5.3 Flash

Four current open-weight chat models are live on /v1/chat/completions with streaming, tool calling and JSON mode. GPT-OSS 120B is the replacement Groq recommends for Llama 3.3 70B; Groq-style ids are accepted as aliases.

2026-09-16 api
Text-to-speech and transcription endpoints

Added /v1/audio/speech (Kokoro 82M with 54 voices, Orpheus 3B) and /v1/audio/transcriptions (Whisper Large v3, Parakeet TDT 0.6B v3). Both follow the OpenAI request shape; speech is billed per character, transcription per audio minute.

2026-09-16 api
OpenAI-compatible base paths and model listing

The gateway now serves /v1/chat/completions, /v1/models and /v1/voices, and accepts /openai/v1/… so Groq-style base URLs work with only the host changed. Streaming responses include usage in the final chunk.

2026-09-16 site
Playgrounds for speech and transcription

Two new browser playgrounds: generate speech with any voice and download the audio, or transcribe an upload / microphone recording with timestamps. Every playground shows the exact cURL request.

2026-09-16 pricing
Published per-model pricing

All rates are on one page: chat per 1M tokens, speech per 1M characters, transcription per audio minute. Llama 3.3 70B was repriced to $1.35 / 1M to reflect upstream cost.

2026-09-16 site
Reference: provider error entries

Started a vendor-neutral error reference with entries for Groq 429 rate_limit_exceeded, the llama-3.3-70b-versatile retirement, and the paused Developer-tier upgrade. Each entry states whether waiting helps and lists every fix, including the ones that do not involve us.

2026-09-16 fix
API authentication and metering

The gateway now requires an API key on every request, checks balance before forwarding, and records per-request usage. Previously the legacy endpoint accepted unauthenticated requests.