Inference APIs
Developers

Integrations

Inference APIs speaks the OpenAI wire format, so most tools connect by changing a base URL. These are the exact settings for each. SDK and framework guides were run end to end against the live API; guides for desktop tools follow the vendor's documented configuration, and each page says which.

Coding agent
Claude Code

Run Claude Code on DeepSeek, GLM, Kimi, MiniMax or GPT-OSS. Claude Code speaks the Anthropic Messages API and nothing else; this endpoint implements it for every chat model, so the switch is three environment variables.

Coding agent
Codex CLI

Run OpenAI's Codex CLI on DeepSeek, GLM, Kimi or GPT-OSS with pay-as-you-go billing. Codex speaks the Responses API; this endpoint implements it for every chat model.

Coding agent
opencode

Add Inference APIs to opencode as a custom OpenAI-compatible provider and use DeepSeek, GLM or Kimi models hosted in the United States, billed per token.

Coding assistant
VS Code Copilot Chat (bring your own key)

Use Inference APIs models in VS Code's Copilot Chat through the Custom Endpoint provider, with your own key and per-token billing.

Voice dictation
TypeWhisper (macOS dictation)

Use Inference APIs for cloud transcription and LLM clean-up in TypeWhisper through its built-in OpenAI Compatible plugin. No extra plugin to install: a server URL, a key and two model ids.

SDK
OpenAI Python SDK

Point the official openai Python package at Inference APIs with base_url. Chat, streaming, tool calling, speech and transcription all work unchanged.

SDK
OpenAI Node.js SDK

Set baseURL on the official openai npm package. Works in Node, Bun, Deno and edge runtimes.

Gateway / SDK
LiteLLM

Use the openai/ prefix with api_base to route any LiteLLM call — SDK or proxy — to Inference APIs, including as a fallback provider.

Framework
LangChain

ChatOpenAI accepts base_url, so chains, agents and LangGraph graphs run on Inference APIs models without any provider-specific package.

Framework
LlamaIndex

Use the OpenAILike LLM class, which exists for exactly this case: an OpenAI-compatible endpoint serving non-OpenAI model ids.

Framework
Vercel AI SDK

Use @ai-sdk/openai-compatible to create a provider for Inference APIs; then streamText, generateText and tool calling work as with any provider.

Coding assistant
Continue (VS Code / JetBrains)

Add Inference APIs models to Continue with provider: openai and an apiBase. Works for chat, edit and autocomplete roles.

Coding agent
Cline (VS Code)

Choose the "OpenAI Compatible" provider in Cline settings and paste the base URL, key and a model id.

Self-hosted chat UI
Open WebUI

One connection gives Open WebUI chat models, speech-to-text and text-to-speech from Inference APIs — useful when the local Whisper or TTS engine is too slow on a CPU host.

Automation
n8n

Create an OpenAI credential in n8n with a custom Base URL; the OpenAI Chat Model, Transcribe and Text-to-Speech nodes then run on Inference APIs.

Dictation app (macOS)
VoiceInk

Use Inference APIs in VoiceInk for cloud transcription and for the AI enhancement step, through VoiceInk's custom model settings. One key covers both, billed per audio minute and per token with no subscription.

Dictation app (macOS)
FluidVoice

Add Inference APIs to FluidVoice as a custom AI provider for the enhancement and command modes. Speech recognition stays on your Mac; only the text clean-up goes to the API.

Coding assistant
Aider

Point aider at Inference APIs with two flags or two environment variables.

Missing your tool? Tell us and we will add a tested guide. The generic recipe is in switching OpenAI-compatible providers.