Company
Blog
Benchmarks, migration notes and how the service is run. RSS
2026-09-16 · benchmarks, chat
Measured: time-to-first-token and throughput for GPT-OSS 120B, DeepSeek V4 Flash, GLM 5.3 Flash and Llama 3.3 70B
We timed every chat model on the public endpoint with a fixed prompt: median time to first token, output tokens per second and total time, plus speech and transcription speed. Numbers, method and caveats.
2026-09-16 · groq, migration
Groq retired llama-3.3-70b-versatile. Here is what broke, and three ways to fix it
On 16 August 2026 Groq shut down llama-3.3-70b-versatile and llama-3.1-8b-instant for free and developer tiers. A month later, hundreds of thousands of code files still pin the id. What the error looks like, who it hit, and the fix ladder.
2026-09-16 · pricing
How we price: upstream cost plus a fixed margin, published per model
Every model is priced at about 30% over what it costs us to serve, and the rate is on the model page. What that means in practice, and why we do not have tiers.