LLM Providers¶

An LLM provider is the large language model endpoint that AI session analysis runs on. Analysis agents reference a provider through their provider_id attribute; an agent without a provider does not run.


Data Structures¶

LlmProviderModel¶

Attribute

Type

Required

Description

id

string

Read-only. Uniqueness is required.

name

string

yes

Provider name. Case-insensitive. Uniqueness is required.

provider

string {anthropic, ollama, openai}

yes

Provider kind the URL speaks.

url

string

If provider == ollama

Endpoint URL. Empty means the provider’s canonical SaaS endpoint.

model

string

yes

Model name requested from the provider.

api_key

string

API key used to authenticate against the provider. Protected; write-only - it is never returned by GET.

temperature

string

Sampling temperature between 0 and 2. Empty means the provider’s default.

builtin

boolean

Read-only; expensive to use; if true, the object is not editable.

hidden

boolean

Read-only; expensive to use; if true, the object is hidden in UI.

created_at

datetime

Read-only. Timestamp of creation.

modified_at

datetime

Read-only. Timestamp of modification.

removed

boolean

Read-only.

Retrieve Available Attributes of the LlmProviderModel¶

Request

Method

GET

Path

/api/v2/objspec/llm_provider

GET /api/v2/objspec/llm_provider

Example Request

curl -s -k -X GET \
  -H 'Authorization: <token>' \
  'https://10.33.3.191/api/v2/objspec/llm_provider'

List LLM Providers¶

Request

Method

GET

Path

/api/v2/llm_provider

GET /api/v2/llm_provider

Example Request

curl -s -k -X GET \
  -H 'Authorization: <token>' \
  'https://10.33.3.191/api/v2/llm_provider'

Response

{
    "result": "success",
    "llm_provider": [
        {
            "id": "4638707616191610881",
            "name": "Local Ollama",
            "provider": "ollama",
            "url": "https://llm.example.com:11434",
            "model": "llama3.1:8b",
            "temperature": "0.2",
            "builtin": false,
            "hidden": false,
            "created_at": "2026-08-18 02:16:42.250842-07",
            "modified_at": "2026-08-18 02:16:42.250842-07"
        }
    ]
}

Get an LLM Provider¶

Request

Method

GET

Path

/api/v2/llm_provider/<id>

GET /api/v2/llm_provider/<id>

Example Request

curl -s -k -X GET \
  -H 'Authorization: <token>' \
  'https://10.33.3.191/api/v2/llm_provider/4638707616191610881'

Response

{
    "result": "success",
    "llm_provider": {
        "id": "4638707616191610881",
        "name": "Local Ollama",
        "provider": "ollama",
        "url": "https://llm.example.com:11434",
        "model": "llama3.1:8b",
        "temperature": "0.2",
        "builtin": false,
        "hidden": false,
        "created_at": "2026-08-18 02:16:42.250842-07",
        "modified_at": "2026-08-18 02:16:42.250842-07"
    }
}

Create an LLM Provider¶

Request

Method

POST

Path

/api/v2/llm_provider

Body

LlmProviderModel

POST /api/v2/llm_provider

Example Request

curl -s -k -X POST \
  -H 'Authorization: <token>' \
  -H 'Content-Type: application/json' \
  -d '{"name":"Local Ollama","provider":"ollama","url":"https://llm.example.com:11434","model":"llama3.1:8b","temperature":"0.2"}' \
  'https://10.33.3.191/api/v2/llm_provider'

Response

{
    "result": "success",
    "llm_provider": {
        "id": "4638707616191610881"
    }
}

Modify an LLM Provider¶

Request

Method

PATCH

Path

/api/v2/llm_provider/<id>

Body

LlmProviderModel

PATCH /api/v2/llm_provider/<id>

Example Request

curl -s -k -X PATCH \
  -H 'Authorization: <token>' \
  -H 'Content-Type: application/json' \
  -d '{"model":"llama3.1:70b","temperature":"0.1"}' \
  'https://10.33.3.191/api/v2/llm_provider/4638707616191610881'

Response

{
    "result": "success"
}

Delete an LLM Provider¶

Request

Method

DELETE

Path

/api/v2/llm_provider/<id>

DELETE /api/v2/llm_provider/<id>

Example Request

curl -s -k -X DELETE \
  -H 'Authorization: <token>' \
  'https://10.33.3.191/api/v2/llm_provider/4638707616191610881'

Response

{
    "result": "success"
}