curl "http://localhost:4700/api/v1/custom-agent-evaluations/runs" \
-H "x-api-key: agtx_local_0f3c9a17d2b84e6a5c01b9f4e7d8a2c6431b5f97a0e2d4c8"
{
"runs": [
{
"_id": "rK7dP2qWx9TzB4mV6nJcE",
"runId": "rK7dP2qWx9TzB4mV6nJcE",
"datasetId": "dS4tG7hNb2VxZ8kQ5wMyA",
"evaluationSettingsId": null,
"evaluationSubject": {
"kind": "custom_agent",
"displayName": "Customer Support Bot",
"framework": "langchain"
},
"status": "completed",
"resultCount": 6,
"averageRating": 7.8,
"liveStatistics": {
"averageRating": 7.8,
"minRating": 5,
"maxRating": 10,
"ratedCount": 6,
"skippedCount": 0,
"failedCount": 0
},
"caseStatistics": [],
"results": [ { "questionIndex": 0, "rating": 8, "...": "..." } ]
}
]
}
Custom Evaluations
List Runs
List the project’s evaluation runs, newest first
GET
/
api
/
v1
/
custom-agent-evaluations
/
runs
curl "http://localhost:4700/api/v1/custom-agent-evaluations/runs" \
-H "x-api-key: agtx_local_0f3c9a17d2b84e6a5c01b9f4e7d8a2c6431b5f97a0e2d4c8"
{
"runs": [
{
"_id": "rK7dP2qWx9TzB4mV6nJcE",
"runId": "rK7dP2qWx9TzB4mV6nJcE",
"datasetId": "dS4tG7hNb2VxZ8kQ5wMyA",
"evaluationSettingsId": null,
"evaluationSubject": {
"kind": "custom_agent",
"displayName": "Customer Support Bot",
"framework": "langchain"
},
"status": "completed",
"resultCount": 6,
"averageRating": 7.8,
"liveStatistics": {
"averageRating": 7.8,
"minRating": 5,
"maxRating": 10,
"ratedCount": 6,
"skippedCount": 0,
"failedCount": 0
},
"caseStatistics": [],
"results": [ { "questionIndex": 0, "rating": 8, "...": "..." } ]
}
]
}
Returns the project’s most recent evaluation runs (up to 50), newest first. Each entry is the
same full run summary Get Run returns, including
liveStatistics and per-result rows.
There is no pagination on this endpoint - it returns at most the 50 newest runs, and query
parameters are ignored. Fetch a specific run by id with
Get Run.
Authentication
string
required
Project API key.
Response
array
Up to 50 run objects, newest first, each in the
Get Run shape:
_id/runId, datasetId,
evaluationSettingsId, evaluationSubject, status
("in_progress" | "completed" | "failed"), resultCount, averageRating,
liveStatistics, caseStatistics, and results.curl "http://localhost:4700/api/v1/custom-agent-evaluations/runs" \
-H "x-api-key: agtx_local_0f3c9a17d2b84e6a5c01b9f4e7d8a2c6431b5f97a0e2d4c8"
{
"runs": [
{
"_id": "rK7dP2qWx9TzB4mV6nJcE",
"runId": "rK7dP2qWx9TzB4mV6nJcE",
"datasetId": "dS4tG7hNb2VxZ8kQ5wMyA",
"evaluationSettingsId": null,
"evaluationSubject": {
"kind": "custom_agent",
"displayName": "Customer Support Bot",
"framework": "langchain"
},
"status": "completed",
"resultCount": 6,
"averageRating": 7.8,
"liveStatistics": {
"averageRating": 7.8,
"minRating": 5,
"maxRating": 10,
"ratedCount": 6,
"skippedCount": 0,
"failedCount": 0
},
"caseStatistics": [],
"results": [ { "questionIndex": 0, "rating": 8, "...": "..." } ]
}
]
}