Inference APIs

Do you store my prompts or audio? Is there zero data retention?

No, and neither do the GPU providers that run the models. This gateway does not retain prompt text, audio uploads, images or generated output, and zero data retention is switched on with both upstream providers, so nothing is kept after the response is returned and nothing is used for training. What is stored per request is metering data: model id, unit counts (tokens, characters or minutes), cost and timestamp. Who holds what is set out on the trust page.

Related

More questions