TokenLab

Compatibility Matrix

Tool and SDK compatibility

Find the right TokenLab setup for coding tools, chat apps, SDKs, and frameworks

Most tools connect to TokenLab by changing an API key and base URL. The exact setup depends on which API format the tool can use.

API formatBase URLCommon clients
Chat Completions (OpenAI-compatible)https://api.tokenlab.sh/v1OpenAI SDKs, many chat apps and frameworks
OpenAI Responseshttps://api.tokenlab.sh/v1Responses clients and tools built around Responses events
Anthropic Messageshttps://api.tokenlab.shAnthropic SDKs and Claude-oriented tools
Geminihttps://api.tokenlab.shGemini REST and SDK clients that allow a custom host

The selected model must list the same format in accepted_request_formats. Streaming and tool calling also depend on the model’s capabilities and the client. See API formats for examples.

Compatibility labels

LabelMeaning
WorksThe linked TokenLab setup uses the client’s documented configuration options
Works with limitsThe configuration applies to specific features or authentication modes; other vendor services keep their own requirements

These labels describe the configuration on the linked page. Feature availability also depends on the selected model and client version.

Coding tools

ToolStatusAPI formatNotes
Claude CodeWorksAnthropic MessagesUses ANTHROPIC_BASE_URL and a TokenLab API key
Codex CLIWorks with limitsResponsesUses Responses; available features depend on the selected model
CursorWorks with limitsOpenAI-compatibleApplies to Cursor features that accept a custom API key and URL
ClineWorksOpenAI-compatibleSelect OpenAI Compatible and enter a base URL and model ID
Kilo CodeWorksOpenAI-compatibleUses a custom provider and model ID
OpenCodeWorksOpenAI-compatibleLoad a separate provider configuration with OPENCODE_CONFIG
OpenHandsWorksOpenAI-compatibleLiteLLM-backed UI: Advanced → Custom Model (openai/ prefix) and Base URL
Gemini CLIWorks with limitsGeminiUse GOOGLE_GEMINI_BASE_URL with API-key authentication; a separate GEMINI_CLI_HOME preserves the existing setup

Chat applications

AppStatusNotes
ChatboxWorksAdd an OpenAI API Compatible provider
Cherry StudioWorksAdd a provider and complete Verify and Enable
DeepChatWorksChoose OpenAI Completions for Chat Completions
JanWorksAdd an OpenAI-compatible service
LibreChatWorksConfigure a custom OpenAI-compatible endpoint
Open WebUIWorksAdd an OpenAI-compatible connection with API Type Chat

SDKs and frameworks

ClientStatusSetup
OpenAI SDKWorksSet base_url / baseURL to https://api.tokenlab.sh/v1
Anthropic SDKWorksSet the base URL to https://api.tokenlab.sh
Vercel AI SDKWorksCreate a custom OpenAI-compatible provider
LangChainWorksConfigure ChatOpenAI or OpenAIEmbeddings with the TokenLab URL
LlamaIndexWorksUse its OpenAI-compatible client options
OpenAI Agents SDKWorks with limitsThe guide uses OpenAIChatCompletionsModel; check model and SDK feature support before using Responses
AutoGenWorksUse an OpenAI-compatible model client
CrewAIWorksConfigure its OpenAI-compatible LLM client
PydanticAIWorksSupply an OpenAI-compatible provider

More frameworks, observability tools, gateways, and evaluation products are listed in the Integrations navigation.

Usage in streamed responses

Chat Completions streams accept stream_options: { include_usage: true }, which appends a final usage chunk before the stream closes. The Responses API does not expose include_usage; Responses streams report usage on their terminal event instead.

What a custom API key does not replace

Some products mix model calls with features hosted by the product vendor. A TokenLab key can power the model requests exposed through BYOK settings, but it does not replace unrelated subscriptions, autocomplete services, account features, or proprietary extensions.

When a tool update changes its configuration, use the current integration page rather than copying an old environment-variable snippet from elsewhere.

Before depending on a feature

  • Confirm the tool allows a custom base URL for the format you need.
  • Confirm the model lists that format in accepted_request_formats.
  • Test streaming and tool calls if your workflow requires them.
  • Keep the API key on a trusted machine or server.
  • Record the Request ID when reporting a failure.

On this page