Create an LLM Config

Create an LLM Config.

Body Params

Request schema for creating a new LLM configuration.

For BYOM (Bring Your Own Model) configurations, provide auth_config_id and model_name.
The auth_config must have purpose=BYO_LLM_PROVIDER and appropriate credentials.

string
required
length ≥ 2

Display name for the new LLM configuration.

string
enum
required

The provider that hosts this LLM (e.g. OPENAI, BEDROCK).

object | null

The extra config jsonschema for the LLM.

ID of the LLM provider credentials.

Required for BYOM configurations. The auth config must have purpose=BYO_LLM_PROVIDER.

length ≥ 1

The specific model name/ID to use with the provider.

Required for BYOM configurations. Examples: 'gpt-4o', 'claude-3-opus-20240229'.

boolean
Defaults to false

Whether this is an embedding model config.

≤ 1536

Output vector dimensions. Required when is_embedding=True.

Responses

Language
Credentials
URL
LoadingLoading…
Response
Choose an example:
application/json