Providers

Toolpack SDK supports multiple AI providers out of the box. You use your own API keys directly - there are no subscription plans or middleman services.

Built-in Providers

Provider	Models	API Key Env Variable
OpenAI	GPT-4o, o1, o3, and more	OPENAI_API_KEY
Anthropic	Claude Sonnet, Haiku, Opus, and more	ANTHROPIC_API_KEY
Gemini	Gemini Flash, Pro, and more	GOOGLE_GENERATIVE_AI_KEY
Ollama	Any locally installed model	None (local)
OpenRouter	300+ models (auto-discovered)	OPENROUTER_API_KEY

Single Provider Setup

The simplest configuration uses one provider:

import { Toolpack } from 'toolpack-sdk';

const toolpack = await Toolpack.init({
    provider: 'openai',
    model: 'gpt-4o',  // optional default model
});

The SDK automatically reads API keys from environment variables:

• OPENAI_API_KEY or TOOLPACK_OPENAI_KEY
• ANTHROPIC_API_KEY or TOOLPACK_ANTHROPIC_KEY
• GOOGLE_GENERATIVE_AI_KEY or TOOLPACK_GEMINI_KEY
• OPENROUTER_API_KEY or TOOLPACK_OPENROUTER_KEY

Or pass the key directly:

const toolpack = await Toolpack.init({
    provider: 'anthropic',
    apiKey: 'sk-ant-...',
});

Multi-Provider Setup

Configure multiple providers and switch between them:

const toolpack = await Toolpack.init({
    providers: {
        openai: { 
            /* Optional - apiKey: process.env.OPENAI_API_KEY, */
        },
        anthropic: { 
            /* Optional - apiKey: process.env.ANTHROPIC_API_KEY, */
        },
        gemini: {
            /* Optional - apiKey: process.env.GOOGLE_GENERATIVE_AI_KEY, */
        },
    },
    defaultProvider: 'openai',
});

// Use default provider (OpenAI)
await toolpack.generate('Hello!');

// Switch to Anthropic
toolpack.setProvider('anthropic');
await toolpack.generate('Hello from Claude!');

// Or specify per-request
await toolpack.generate(
    { messages: [{ role: 'user', content: 'Hello!' }], model: 'gpt-4o' },
    'openai'  // provider name
);

Ollama (Local Models)

Ollama runs models locally - no API key required:

const toolpack = await Toolpack.init({
    provider: 'ollama',
});

// List available local models
const providers = await toolpack.listProviders();
console.log(providers);

// Use a specific model
const response = await toolpack.generate({
    messages: [{ role: 'user', content: 'Hello!' }],
    model: 'llama3.2',
});

Configure a custom Ollama host:

const toolpack = await Toolpack.init({
    providers: {
        ollama: {
            baseUrl: 'http://192.168.1.100:11434',
        },
    },
    defaultProvider: 'ollama',
});

Custom Base URLs

Use OpenAI-compatible APIs (like Azure OpenAI, local proxies, or other compatible services):

const toolpack = await Toolpack.init({
    providers: {
        openai: {
            apiKey: 'your-key',
            baseUrl: 'https://your-openai-compatible-api.com/v1',
        },
    },
    defaultProvider: 'openai',
});

Listing Available Models

Get all models from all configured providers:

// List all providers and their models
const providers = await toolpack.listProviders();
for (const provider of providers) {
    console.log(`${provider.displayName}:`);
    for (const model of provider.models) {
        console.log(`  - ${model.id} (${model.displayName})`);
    }
}

// Or get a flat list of all models
const models = await toolpack.listModels();
console.log(models);

OpenRouter

OpenRouter gives you access to 300+ models from providers like OpenAI, Anthropic, Google, Meta, and more — all through a single OpenAI-compatible API.

const toolpack = await Toolpack.init({
    provider: 'openrouter',
    // Reads OPENROUTER_API_KEY from env, or pass directly:
    // apiKey: 'sk-or-...',
});

// OpenRouter auto-discovers all available models
const models = await toolpack.listModels();

// Use any model by its OpenRouter ID
const response = await toolpack.generate({
    model: 'anthropic/claude-sonnet-4',
    messages: [{ role: 'user', content: 'Hello!' }],
});

With attribution options

const toolpack = await Toolpack.init({
    providers: {
        openrouter: {
            apiKey: process.env.OPENROUTER_API_KEY,
            siteUrl: 'https://your-app.com',   // Optional: for OpenRouter leaderboard
            siteName: 'Your App Name',          // Optional: for OpenRouter leaderboard
        },
    },
});

Capability notes

Feature	Support
Chat completions	✅
Streaming	✅
Tool/function calling	✅
Embeddings	❌
Vision	✅ (model-dependent)
Model discovery	Dynamic (via /models endpoint)

Custom Providers

You can create and inject your own provider adapters. See Custom Providers for details.