Model Providers¶
Agentlab ships with two built-in model providers — KARLI and tokeneurope — alongside the standard Langflow providers (OpenAI, Anthropic, etc.). Unlike earlier versions, there is no dedicated "KARLI Model Provider" component — providers are surfaced through the standard Langflow model components.
Models are grouped by type:
- LLMs — Chat models from KARLI and tokeneurope, selectable from any component that accepts a model (Language Model, Agent, etc.).
- Embeddings — KARLI-hosted embedding models, selectable from the Embedding Model component.
- Data Extraction — KARLI-hosted document- and audio-extraction models, used by the Read File component when its backend is set to
karli. KARLI is currently the only provider offering this category.
KARLI¶
KARLI is the default provider, offering LLMs, embeddings, and document extraction via the KARLI platform.
Credentials¶
The KARLI provider uses two separate endpoints — a LiteLLM proxy for LLM inference (including tool calling) and the KARLI backend for services like document extraction. Each endpoint has its own base URL and API key.
| Variable | Required | Secret | Description |
|---|---|---|---|
LITELLM_BASE_URL |
No | No | Base URL of the LiteLLM proxy used for LLM inference. Falls back to the LITELLM_BASE_URL environment variable; defaults to the production endpoint when neither is set. |
LITELLM_API_KEY |
Yes | Yes | API key for LLM inference via the LiteLLM proxy. Falls back to the LITELLM_API_KEY environment variable. |
KARLI_BASE_URL |
No | No | Base URL of the KARLI backend (used for document extraction and other backend services). Falls back to the KARLI_BASE_URL environment variable. |
KARLI_API_KEY |
No | Yes | API key for KARLI backend services (e.g. document extraction). Falls back to the KARLI_API_KEY environment variable. |
When is KARLI_API_KEY needed?
Only when accessing the Agentlab API directly without a Karli Studio session. When accessed through Karli Studio, a JWT is used automatically and this field is ignored. Leave it blank if you use Studio.
KARLI_API_KEY is a separate credential from LITELLM_API_KEY. The LiteLLM key covers model inference; the KARLI key covers backend services such as document extraction.
tokeneurope¶
tokeneurope is a European-hosted model provider offering OpenAI-compatible LLM access. Like KARLI, it appears as a selectable provider in any model-aware component.
Credentials¶
| Variable | Required | Secret | Description |
|---|---|---|---|
TOKENEUROPE_BASE_URL |
No | No | Base URL for the tokeneurope endpoint. Falls back to the TOKENEUROPE_BASE_URL environment variable. |
TOKENEUROPE_API_KEY |
Yes | Yes | API key for tokeneurope model inference. Falls back to the TOKENEUROPE_API_KEY environment variable. |
tokeneurope currently offers LLMs only — it does not provide embedding or data-extraction models.
Data Sovereignty
For deployments with data sovereignty requirements, the Karli Studio administrator controls which providers are enabled at the platform level so that only models hosted in approved regions are reachable.