repository·main·Indexed 43 days ago
https://github.com/token-js/token.jsA TypeScript SDK that provides a unified, OpenAI-compatible API format to integrate with over 200 LLMs from 10+ providers, including OpenAI, Anthropic, Gemini, Mistral, and AWS Bedrock. It runs entirely on the client side without requiring a proxy server and supports features such as streaming, function calling (tools), and custom model extensions via extendModelList().
Token.js provides a unified interface to integrate various Large Language Model (LLM) providers. You can use the following providers within your application:
While Token.js works with any provider following the OpenAI v1 API spec, features like image input, tool use, and streaming depend on the specific capabilities of the provider and model being used. It is recommended to check the provider's documentation if these features do not behave as expected.
Commonly used compatible providers:
Note on Official Support: Providers using the OpenAI compatible spec are not considered 'officially supported'. Official support includes dedicated integration testing, improved type support, and better documentation for specific features. If you use a compatible provider frequently, you can request official support by opening a GitHub issue.
To use Perplexity as a provider in Token.js, you must first obtain an API key from the Perplexity settings page. Once obtained, configure your environment by setting the PERPLEXITY_API_KEY environment variable.
PERPLEXITY_API_KEY=To use Cohere with Token.js, you must provide a Cohere API key via the COHERE_API_KEY environment variable. You can obtain a key from the Cohere Dashboard.
COHERE_API_KEY=To use Token.js in your TypeScript project, install the package using npm:
npm install token.jsTo use Mistral with Token.js, you must provide a Mistral API key. Set the MISTRAL_API_KEY environment variable in your .env file.
MISTRAL_API_KEY=To use AI21 with Token.js, you must provide an API key via the AI21_API_KEY environment variable. You can obtain a key from the AI21 Studio.
AI21_API_KEY=To use Anthropic models with Token.js, you must provide an Anthropic API key. Set the ANTHROPIC_API_KEY environment variable in your project's .env file.
You can obtain a key from the Anthropic Console.
ANTHROPIC_API_KEY=To use AWS Bedrock with Token.js, you must provide your AWS credentials via environment variables. Ensure you have obtained your credentials from the AWS Console.
Required environment variables:
AWS_REGION_NAMEAWS_ACCESS_KEY_IDAWS_SECRET_ACCESS_KEYAWS_REGION_NAME=
AWS_ACCESS_KEY_ID=
AWS_SECRET_ACCESS_KEY=For OpenAI compatible providers that require an API key, you can provide the key via the OPENAI_COMPATIBLE_API_KEY environment variable. This is common for many third-party providers, though typically not required for local instances like Ollama.
OPENAI_COMPATIBLE_API_KEY=your_api_key_here