Inference APIs

Why is the reply empty on GPT-OSS, DeepSeek or GLM?

They are reasoning models: they think before they answer, and the thinking consumes max_tokens. If the budget is small (say 20–50 tokens) it is spent entirely on reasoning and content comes back empty while reasoning (GPT-OSS) or reasoning_content (DeepSeek, GLM) is populated. Set max_tokens to a few hundred or more, and lower the thinking itself with reasoning_effort: "low" on GPT-OSS and GLM or "reasoning": {"enabled": false} on DeepSeek. usage.completion_tokens_details.reasoning_tokens shows how many tokens went to reasoning.

Related

More questions