LLM Providers¶
An LLM provider is the large language model endpoint that AI session analysis runs on. Analysis
agents reference a provider through their provider_id attribute; an agent without a provider does
not run.
Data Structures¶
Attribute |
Type |
Required |
Description |
|---|---|---|---|
|
string |
Read-only. Uniqueness is required. |
|
|
string |
yes |
Provider name. Case-insensitive. Uniqueness is required. |
|
string {anthropic, ollama, openai} |
yes |
Provider kind the URL speaks. |
|
string |
If |
Endpoint URL. Empty means the provider’s canonical SaaS endpoint. |
|
string |
yes |
Model name requested from the provider. |
|
string |
API key used to authenticate against the provider. Protected; write-only - it is never returned by |
|
|
string |
Sampling temperature between 0 and 2. Empty means the provider’s default. |
|
|
boolean |
Read-only; expensive to use; if |
|
|
boolean |
Read-only; expensive to use; if |
|
|
datetime |
Read-only. Timestamp of creation. |
|
|
datetime |
Read-only. Timestamp of modification. |
|
|
boolean |
Read-only. |
Retrieve Available Attributes of the LlmProviderModel¶
Request
Method |
|
Path |
|
GET /api/v2/objspec/llm_provider
Example Request
curl -s -k -X GET \
-H 'Authorization: <token>' \
'https://10.33.3.191/api/v2/objspec/llm_provider'
List LLM Providers¶
Request
Method |
|
Path |
|
GET /api/v2/llm_provider
Example Request
curl -s -k -X GET \
-H 'Authorization: <token>' \
'https://10.33.3.191/api/v2/llm_provider'
Response
{
"result": "success",
"llm_provider": [
{
"id": "4638707616191610881",
"name": "Local Ollama",
"provider": "ollama",
"url": "https://llm.example.com:11434",
"model": "llama3.1:8b",
"temperature": "0.2",
"builtin": false,
"hidden": false,
"created_at": "2026-08-18 02:16:42.250842-07",
"modified_at": "2026-08-18 02:16:42.250842-07"
}
]
}
Get an LLM Provider¶
Request
Method |
|
Path |
|
GET /api/v2/llm_provider/<id>
Example Request
curl -s -k -X GET \
-H 'Authorization: <token>' \
'https://10.33.3.191/api/v2/llm_provider/4638707616191610881'
Response
{
"result": "success",
"llm_provider": {
"id": "4638707616191610881",
"name": "Local Ollama",
"provider": "ollama",
"url": "https://llm.example.com:11434",
"model": "llama3.1:8b",
"temperature": "0.2",
"builtin": false,
"hidden": false,
"created_at": "2026-08-18 02:16:42.250842-07",
"modified_at": "2026-08-18 02:16:42.250842-07"
}
}
Create an LLM Provider¶
Request
Method |
|
Path |
|
Body |
|
POST /api/v2/llm_provider
Example Request
curl -s -k -X POST \
-H 'Authorization: <token>' \
-H 'Content-Type: application/json' \
-d '{"name":"Local Ollama","provider":"ollama","url":"https://llm.example.com:11434","model":"llama3.1:8b","temperature":"0.2"}' \
'https://10.33.3.191/api/v2/llm_provider'
Response
{
"result": "success",
"llm_provider": {
"id": "4638707616191610881"
}
}
Modify an LLM Provider¶
Request
Method |
|
Path |
|
Body |
|
PATCH /api/v2/llm_provider/<id>
Example Request
curl -s -k -X PATCH \
-H 'Authorization: <token>' \
-H 'Content-Type: application/json' \
-d '{"model":"llama3.1:70b","temperature":"0.1"}' \
'https://10.33.3.191/api/v2/llm_provider/4638707616191610881'
Response
{
"result": "success"
}
Delete an LLM Provider¶
Request
Method |
|
Path |
|
DELETE /api/v2/llm_provider/<id>
Example Request
curl -s -k -X DELETE \
-H 'Authorization: <token>' \
'https://10.33.3.191/api/v2/llm_provider/4638707616191610881'
Response
{
"result": "success"
}