curl "http://localhost:4700/api/v1/custom-agent-evaluations/datasets/dS4tG7hNb2VxZ8kQ5wMyA" \
-H "x-api-key: agtx_local_0f3c9a17d2b84e6a5c01b9f4e7d8a2c6431b5f97a0e2d4c8"
dataset = client.evaluations.datasets.get("dS4tG7hNb2VxZ8kQ5wMyA")
{
"_id": "dS4tG7hNb2VxZ8kQ5wMyA",
"name": "Customer Support Q3 2026",
"description": "Core support questions",
"numberOfRequests": 3,
"vectorSimilarity": { "enabled": true },
"jaccardSimilarity": { "enabled": true },
"acceptanceCriteria": "Accurate, empathetic, resolves the issue",
"rejectionCriteria": "Hallucinates, ignores the question",
"questions": [
{
"main_question": {
"query": "How do I reset my password?",
"expectedResults": "Click Forgot Password on the login screen."
}
}
],
"status": "published",
"createdAt": "2026-08-27T10:00:00.000Z"
}
{
"error": "Dataset not found"
}
Custom Evaluations
Get Dataset
Fetch a single evaluation dataset by id
GET
/
api
/
v1
/
custom-agent-evaluations
/
datasets
/
{datasetId}
curl "http://localhost:4700/api/v1/custom-agent-evaluations/datasets/dS4tG7hNb2VxZ8kQ5wMyA" \
-H "x-api-key: agtx_local_0f3c9a17d2b84e6a5c01b9f4e7d8a2c6431b5f97a0e2d4c8"
dataset = client.evaluations.datasets.get("dS4tG7hNb2VxZ8kQ5wMyA")
{
"_id": "dS4tG7hNb2VxZ8kQ5wMyA",
"name": "Customer Support Q3 2026",
"description": "Core support questions",
"numberOfRequests": 3,
"vectorSimilarity": { "enabled": true },
"jaccardSimilarity": { "enabled": true },
"acceptanceCriteria": "Accurate, empathetic, resolves the issue",
"rejectionCriteria": "Hallucinates, ignores the question",
"questions": [
{
"main_question": {
"query": "How do I reset my password?",
"expectedResults": "Click Forgot Password on the login screen."
}
}
],
"status": "published",
"createdAt": "2026-08-27T10:00:00.000Z"
}
{
"error": "Dataset not found"
}
Returns one dataset from the project selected by your API key, including its full
questions
array and grading configuration. Same document shape as the items in
List Datasets.
Authentication
string
required
Project API key.
Path Parameters
string
required
Dataset
_id.Errors
| Status | Body | Meaning |
|---|---|---|
404 | { "error": "Dataset not found" } | No dataset with this id in the project |
curl "http://localhost:4700/api/v1/custom-agent-evaluations/datasets/dS4tG7hNb2VxZ8kQ5wMyA" \
-H "x-api-key: agtx_local_0f3c9a17d2b84e6a5c01b9f4e7d8a2c6431b5f97a0e2d4c8"
dataset = client.evaluations.datasets.get("dS4tG7hNb2VxZ8kQ5wMyA")
{
"_id": "dS4tG7hNb2VxZ8kQ5wMyA",
"name": "Customer Support Q3 2026",
"description": "Core support questions",
"numberOfRequests": 3,
"vectorSimilarity": { "enabled": true },
"jaccardSimilarity": { "enabled": true },
"acceptanceCriteria": "Accurate, empathetic, resolves the issue",
"rejectionCriteria": "Hallucinates, ignores the question",
"questions": [
{
"main_question": {
"query": "How do I reset my password?",
"expectedResults": "Click Forgot Password on the login screen."
}
}
],
"status": "published",
"createdAt": "2026-08-27T10:00:00.000Z"
}
{
"error": "Dataset not found"
}