result = client.tracer.evaluate_trace( trace_id="mJ3vQ8pTr2LqYw6bZk9Xd", dataset_id="dS4tG7hNb2VxZ8kQ5wMyA",)print(result["rating"])print(result["justification"])
{ "run_id": "rK7dP2qWx9TzB4mV6nJcE", "trace_id": "mJ3vQ8pTr2LqYw6bZk9Xd", "rating": 8, "justification": "The agent correctly described the password reset flow and provided accurate step-by-step instructions.", "status": "completed"}
{ "error": "Trace not found"}
Tracing
Evaluate Trace
Score a recorded trace against a dataset or grading config without re-running the agent
result = client.tracer.evaluate_trace( trace_id="mJ3vQ8pTr2LqYw6bZk9Xd", dataset_id="dS4tG7hNb2VxZ8kQ5wMyA",)print(result["rating"])print(result["justification"])
{ "run_id": "rK7dP2qWx9TzB4mV6nJcE", "trace_id": "mJ3vQ8pTr2LqYw6bZk9Xd", "rating": 8, "justification": "The agent correctly described the password reset flow and provided accurate step-by-step instructions.", "status": "completed"}
{ "error": "Trace not found"}
Grades the trace’s recorded input/output against a dataset’s (or standalone grading config’s)
criteria, as a real one-result evaluation run. The agent is not called again. The run is
stored with runSource: "trace-eval" and shows up in Evaluate → Runs like any other, but it is
never used as a no-regression baseline for full runs.Scoring uses the full run-scoring stack: the LLM judge (which needs a judge provider key
configured), the trace’s recorded tool trajectory, retrieval context, and any code scorers on
the config.
Need a traceId? Submit Trace returns one on every
call. In the Python SDK, only client.tracer.trace(..., sync=True) (context manager) gets it
back synchronously; the decorator form is fire-and-forget and never returns an id.
Authentication
string
required
Project API key.
Path Parameters
string
required
ID of the trace to evaluate, returned by POST /ingest/traces.
Body
string
required
ID of the dataset or standalone evaluation-settings config to score against. Datasets
grade with their own criteria; a grading config brings its own judge prompt/model.
The Python SDK’s question_index argument is sent on the wire but ignored by the
self-host engine - the trace is scored against the config’s general criteria, not one
question’s expectedResults.
Response
This response keeps its historical snake_case keys (run_id, trace_id) - they are the
actual wire keys, matching what the Python SDK’s evaluate_trace() reads.
string
ID of the created one-result evaluation run.
string
Echoed back for confirmation.
number | null
Score from 0 (poor) to 10 (excellent). null when the judge could not score (for example,
no judge LLM key is configured) - the run’s result row records the reason.
string | null
LLM-generated explanation of the score.
string
Always "completed" on success.
Errors
Status
Body
Meaning
400
{ "error": "traceId and datasetId are required" }
Missing path or body parameter
404
{ "error": "Trace not found" }
No such trace in this project
404
{ "error": "Dataset or evaluator config not found" }
datasetId matches neither a dataset nor a grading config
result = client.tracer.evaluate_trace( trace_id="mJ3vQ8pTr2LqYw6bZk9Xd", dataset_id="dS4tG7hNb2VxZ8kQ5wMyA",)print(result["rating"])print(result["justification"])
{ "run_id": "rK7dP2qWx9TzB4mV6nJcE", "trace_id": "mJ3vQ8pTr2LqYw6bZk9Xd", "rating": 8, "justification": "The agent correctly described the password reset flow and provided accurate step-by-step instructions.", "status": "completed"}
{ "error": "Trace not found"}
{"docsConfig":{"theme":"mint","$schema":"https://mintlify.com/docs.json","name":"AgentX","colors":{"primary":"#2A5699","light":"#5C8DCC","dark":"#1A3F73"},"logo":{"light":"https://mintcdn.com/agentx-ffe8d995/ZTzZ3HDQJ-RJxymw/logo/light.png?fit=max\u0026auto=format\u0026n=ZTzZ3HDQJ-RJxymw\u0026q=85\u0026s=c1e30c949dc1cc2aaa3a137c1ee5c77f","dark":"https://mintcdn.com/agentx-ffe8d995/ZTzZ3HDQJ-RJxymw/logo/dark.png?fit=max\u0026auto=format\u0026n=ZTzZ3HDQJ-RJxymw\u0026q=85\u0026s=35a521e090f7875c15bef7ae392af788"},"favicon":"https://mintcdn.com/agentx-ffe8d995/FRrvmlkH0m2BUb9c/logo/favicon.png?fit=max\u0026auto=format\u0026n=FRrvmlkH0m2BUb9c\u0026q=85\u0026s=e87d636d38c8e6e187b4be187e72381d","api":{"mdx":{"auth":{"method":"key","name":"x-api-key"},"server":"http://localhost:4700"}},"navbar":{"primary":{"type":"github","href":"https://github.com/AgentX-ai/AgentX-trace-eval"}},"footer":{"socials":{"website":"https://www.agentx.so/mcp/ai-evaluation","github":"https://github.com/AgentX-ai/AgentX-trace-eval"}},"styling":{"latex":true},"navigation":{"pages":[]}},"deployment":{"deploymentMetadataValue":{"subdomain":"agentx-ffe8d995","hasAudioNarration":false,"actualSubdomain":"agentx-ffe8d995","customDomains":["developers.agentx.so"],"gitSource":{"type":"github","owner":"agentx-ai","repo":"agentx-mintlify","deployBranch":"main","contentDirectory":"","isPrivate":true,"mountPath":"","label":""},"entitlements":{"AI_CHAT":{"status":"DISABLED"}},"buildId":"6ac683381cb9dd011c327d04","clientVersion":"0.0.4270","searchFilterCounts":[{"language":"default","tag":"API Reference","count":25},{"language":"default","tag":"Offline Evaluation","count":24},{"language":"default","tag":"Trace","count":17},{"language":"default","tag":"Scorers \u0026 Monitoring","count":16},{"language":"default","tag":"Custom Evaluations","count":13},{"language":"default","tag":"Documentation","count":13},{"language":"default","tag":"Framework Integrations","count":12},{"language":"default","tag":"Framework Examples","count":10},{"language":"default","tag":"Tracing","count":8},{"language":"default","tag":"Live Traffic Scoring","count":7}]},"assistantConfig":{"enableAskAiButton":false,"enableStarterQuestions":false,"enableContextualStarterQuestions":false,"enableAskAiSearchBar":true},"basePath":"","hasChatPermissions":false,"hasWebMcpPermissions":false,"toggles":[],"googleFontsInlined":false},"customCss":[]}
{"page":{"pagePath":"api-reference/tracing/evaluate-trace","slug":"/api-reference/tracing/evaluate-trace","pageMetadata":{"title":"Evaluate Trace","api":"POST /api/v1/ingest/traces/{traceId}/evaluate","description":"Score a recorded trace against a dataset or grading config without re-running the agent","href":"/api-reference/tracing/evaluate-trace"},"description":{"compiledSource":"\"use strict\";\nconst {jsx: _jsx} = arguments[0];\nconst {useMDXComponents: _provideComponents} = arguments[0];\nfunction _createMdxContent(props) {\n const _components = {\n p: \"p\",\n ..._provideComponents(),\n ...props.components\n };\n return _jsx(_components.p, {\n children: \"Score a recorded trace against a dataset or grading config without re-running the agent\"\n });\n}\nfunction MDXContent(props = {}) {\n const {wrapper: MDXLayout} = {\n ..._provideComponents(),\n ...props.components\n };\n return MDXLayout ? _jsx(MDXLayout, {\n ...props,\n children: _jsx(_createMdxContent, {\n ...props\n })\n }) : _createMdxContent(props);\n}\nreturn {\n default: MDXContent\n};\n","frontmatter":{},"scope":{}},"pageType":"default","mdx":{"mdxSource":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx,jsxs:_jsxs}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){const _components={a:`a`,code:`code`,p:`p`,strong:`strong`,tbody:`tbody`,td:`td`,th:`th`,thead:`thead`,tr:`tr`,..._provideComponents(),...props.components},{Heading,Note,ParamField,ResponseField,Table}=_components;if(!Heading)_missingMdxReference(`Heading`,true);if(!Note)_missingMdxReference(`Note`,true);if(!ParamField)_missingMdxReference(`ParamField`,true);if(!ResponseField)_missingMdxReference(`ResponseField`,true);if(!Table)_missingMdxReference(`Table`,true);return _jsxs(_Fragment,{children:[_jsxs(_components.p,{children:[`Grades the trace’s recorded input/output against a dataset’s (or standalone grading config’s)\ncriteria, as a real one-result evaluation run. The agent is `,_jsx(_components.strong,{children:`not`}),` called again. The run is\nstored with `,_jsx(_components.code,{children:`runSource: \"trace-eval\"`}),` and shows up in Evaluate → Runs like any other, but it is\nnever used as a no-regression baseline for full runs.`]}),`\n`,_jsx(_components.p,{children:`Scoring uses the full run-scoring stack: the LLM judge (which needs a judge provider key\nconfigured), the trace’s recorded tool trajectory, retrieval context, and any code scorers on\nthe config.`}),`\n`,_jsx(Note,{children:_jsxs(_components.p,{children:[`Need a `,_jsx(_components.code,{children:`traceId`}),`? `,_jsx(_components.a,{href:`/api-reference/tracing/submit-trace`,children:`Submit Trace`}),` returns one on every\ncall. In the Python SDK, only `,_jsx(_components.code,{children:`client.tracer.trace(..., sync=True)`}),` (context manager) gets it\nback synchronously; the decorator form is fire-and-forget and never returns an id.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`authentication`,children:`Authentication`}),`\n`,_jsx(ParamField,{header:`x-api-key`,type:`string`,required:true,id:`param-x-api-key`,children:_jsx(_components.p,{children:`Project API key.`})}),`\n`,_jsx(Heading,{level:`2`,id:`path-parameters`,children:`Path Parameters`}),`\n`,_jsx(ParamField,{path:`traceId`,type:`string`,required:true,id:`param-trace-id`,children:_jsxs(_components.p,{children:[`ID of the trace to evaluate, returned by `,_jsx(_components.code,{children:`POST /ingest/traces`}),`.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`body`,children:`Body`}),`\n`,_jsx(ParamField,{body:`datasetId`,type:`string`,required:true,id:`param-dataset-id`,children:_jsxs(_components.p,{children:[`ID of the dataset `,_jsx(_components.strong,{children:`or`}),` standalone evaluation-settings config to score against. Datasets\ngrade with their own criteria; a grading config brings its own judge prompt/model.`]})}),`\n`,_jsx(Note,{children:_jsxs(_components.p,{children:[`The Python SDK’s `,_jsx(_components.code,{children:`question_index`}),` argument is sent on the wire but `,_jsx(_components.strong,{children:`ignored`}),` by the\nself-host engine - the trace is scored against the config’s general criteria, not one\nquestion’s `,_jsx(_components.code,{children:`expectedResults`}),`.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`response`,children:`Response`}),`\n`,_jsx(Note,{children:_jsxs(_components.p,{children:[`This response keeps its historical snake_case keys (`,_jsx(_components.code,{children:`run_id`}),`, `,_jsx(_components.code,{children:`trace_id`}),`) - they are the\nactual wire keys, matching what the Python SDK’s `,_jsx(_components.code,{children:`evaluate_trace()`}),` reads.`]})}),`\n`,_jsx(ResponseField,{name:`run_id`,type:`string`,id:`param-run-id`,children:_jsx(_components.p,{children:`ID of the created one-result evaluation run.`})}),`\n`,_jsx(ResponseField,{name:`trace_id`,type:`string`,id:`param-trace-id-1`,children:_jsx(_components.p,{children:`Echoed back for confirmation.`})}),`\n`,_jsx(ResponseField,{name:`rating`,type:`number | null`,id:`param-rating`,children:_jsxs(_components.p,{children:[`Score from 0 (poor) to 10 (excellent). `,_jsx(_components.code,{children:`null`}),` when the judge could not score (for example,\nno judge LLM key is configured) - the run’s result row records the reason.`]})}),`\n`,_jsx(ResponseField,{name:`justification`,type:`string | null`,id:`param-justification`,children:_jsx(_components.p,{children:`LLM-generated explanation of the score.`})}),`\n`,_jsx(ResponseField,{name:`status`,type:`string`,id:`param-status`,children:_jsxs(_components.p,{children:[`Always `,_jsx(_components.code,{children:`\"completed\"`}),` on success.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`errors`,children:`Errors`}),`\n`,_jsxs(Table,{children:[_jsx(_components.thead,{children:_jsxs(_components.tr,{children:[_jsx(_components.th,{children:`Status`}),_jsx(_components.th,{children:`Body`}),_jsx(_components.th,{children:`Meaning`})]})}),_jsxs(_components.tbody,{children:[_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`400`})}),_jsx(_components.td,{children:_jsx(_components.code,{children:`{ \"error\": \"traceId and datasetId are required\" }`})}),_jsx(_components.td,{children:`Missing path or body parameter`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`404`})}),_jsx(_components.td,{children:_jsx(_components.code,{children:`{ \"error\": \"Trace not found\" }`})}),_jsx(_components.td,{children:`No such trace in this project`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`404`})}),_jsx(_components.td,{children:_jsx(_components.code,{children:`{ \"error\": \"Dataset or evaluator config not found\" }`})}),_jsxs(_components.td,{children:[_jsx(_components.code,{children:`datasetId`}),` matches neither a dataset nor a grading config`]})]})]})]})]})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent};function _missingMdxReference(id,component){throw new Error(`Expected `+(component?`component`:`object`)+\" `\"+id+\"` to be defined: you likely forgot to import, pass, or provide it.\")}","frontmatter":{},"scope":{"config":{},"pageMetadata":{"title":"Evaluate Trace","api":"POST /api/v1/ingest/traces/{traceId}/evaluate","description":"Score a recorded trace against a dataset or grading config without re-running the agent","href":"/api-reference/tracing/evaluate-trace"}}},"mdxSourceWithNoJs":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx,jsxs:_jsxs}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){const _components={a:`a`,code:`code`,p:`p`,pre:`pre`,span:`span`,strong:`strong`,tbody:`tbody`,td:`td`,th:`th`,thead:`thead`,tr:`tr`,..._provideComponents(),...props.components},{CodeBlock,Heading,Note,ParamField,RequestExample,ResponseExample,ResponseField,Table}=_components;if(!CodeBlock)_missingMdxReference(`CodeBlock`,true);if(!Heading)_missingMdxReference(`Heading`,true);if(!Note)_missingMdxReference(`Note`,true);if(!ParamField)_missingMdxReference(`ParamField`,true);if(!RequestExample)_missingMdxReference(`RequestExample`,true);if(!ResponseExample)_missingMdxReference(`ResponseExample`,true);if(!ResponseField)_missingMdxReference(`ResponseField`,true);if(!Table)_missingMdxReference(`Table`,true);return _jsxs(_Fragment,{children:[_jsxs(_components.p,{children:[`Grades the trace’s recorded input/output against a dataset’s (or standalone grading config’s)\ncriteria, as a real one-result evaluation run. The agent is `,_jsx(_components.strong,{children:`not`}),` called again. The run is\nstored with `,_jsx(_components.code,{children:`runSource: \"trace-eval\"`}),` and shows up in Evaluate → Runs like any other, but it is\nnever used as a no-regression baseline for full runs.`]}),`\n`,_jsx(_components.p,{children:`Scoring uses the full run-scoring stack: the LLM judge (which needs a judge provider key\nconfigured), the trace’s recorded tool trajectory, retrieval context, and any code scorers on\nthe config.`}),`\n`,_jsx(Note,{children:_jsxs(_components.p,{children:[`Need a `,_jsx(_components.code,{children:`traceId`}),`? `,_jsx(_components.a,{href:`/api-reference/tracing/submit-trace`,children:`Submit Trace`}),` returns one on every\ncall. In the Python SDK, only `,_jsx(_components.code,{children:`client.tracer.trace(..., sync=True)`}),` (context manager) gets it\nback synchronously; the decorator form is fire-and-forget and never returns an id.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`authentication`,children:`Authentication`}),`\n`,_jsx(ParamField,{header:`x-api-key`,type:`string`,required:true,id:`param-x-api-key`,children:_jsx(_components.p,{children:`Project API key.`})}),`\n`,_jsx(Heading,{level:`2`,id:`path-parameters`,children:`Path Parameters`}),`\n`,_jsx(ParamField,{path:`traceId`,type:`string`,required:true,id:`param-trace-id`,children:_jsxs(_components.p,{children:[`ID of the trace to evaluate, returned by `,_jsx(_components.code,{children:`POST /ingest/traces`}),`.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`body`,children:`Body`}),`\n`,_jsx(ParamField,{body:`datasetId`,type:`string`,required:true,id:`param-dataset-id`,children:_jsxs(_components.p,{children:[`ID of the dataset `,_jsx(_components.strong,{children:`or`}),` standalone evaluation-settings config to score against. Datasets\ngrade with their own criteria; a grading config brings its own judge prompt/model.`]})}),`\n`,_jsx(Note,{children:_jsxs(_components.p,{children:[`The Python SDK’s `,_jsx(_components.code,{children:`question_index`}),` argument is sent on the wire but `,_jsx(_components.strong,{children:`ignored`}),` by the\nself-host engine - the trace is scored against the config’s general criteria, not one\nquestion’s `,_jsx(_components.code,{children:`expectedResults`}),`.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`response`,children:`Response`}),`\n`,_jsx(Note,{children:_jsxs(_components.p,{children:[`This response keeps its historical snake_case keys (`,_jsx(_components.code,{children:`run_id`}),`, `,_jsx(_components.code,{children:`trace_id`}),`) - they are the\nactual wire keys, matching what the Python SDK’s `,_jsx(_components.code,{children:`evaluate_trace()`}),` reads.`]})}),`\n`,_jsx(ResponseField,{name:`run_id`,type:`string`,id:`param-run-id`,children:_jsx(_components.p,{children:`ID of the created one-result evaluation run.`})}),`\n`,_jsx(ResponseField,{name:`trace_id`,type:`string`,id:`param-trace-id-1`,children:_jsx(_components.p,{children:`Echoed back for confirmation.`})}),`\n`,_jsx(ResponseField,{name:`rating`,type:`number | null`,id:`param-rating`,children:_jsxs(_components.p,{children:[`Score from 0 (poor) to 10 (excellent). `,_jsx(_components.code,{children:`null`}),` when the judge could not score (for example,\nno judge LLM key is configured) - the run’s result row records the reason.`]})}),`\n`,_jsx(ResponseField,{name:`justification`,type:`string | null`,id:`param-justification`,children:_jsx(_components.p,{children:`LLM-generated explanation of the score.`})}),`\n`,_jsx(ResponseField,{name:`status`,type:`string`,id:`param-status`,children:_jsxs(_components.p,{children:[`Always `,_jsx(_components.code,{children:`\"completed\"`}),` on success.`]})}),`\n`,_jsx(Heading,{level:`2`,id:`errors`,children:`Errors`}),`\n`,_jsxs(Table,{children:[_jsx(_components.thead,{children:_jsxs(_components.tr,{children:[_jsx(_components.th,{children:`Status`}),_jsx(_components.th,{children:`Body`}),_jsx(_components.th,{children:`Meaning`})]})}),_jsxs(_components.tbody,{children:[_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`400`})}),_jsx(_components.td,{children:_jsx(_components.code,{children:`{ \"error\": \"traceId and datasetId are required\" }`})}),_jsx(_components.td,{children:`Missing path or body parameter`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`404`})}),_jsx(_components.td,{children:_jsx(_components.code,{children:`{ \"error\": \"Trace not found\" }`})}),_jsx(_components.td,{children:`No such trace in this project`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`404`})}),_jsx(_components.td,{children:_jsx(_components.code,{children:`{ \"error\": \"Dataset or evaluator config not found\" }`})}),_jsxs(_components.td,{children:[_jsx(_components.code,{children:`datasetId`}),` matches neither a dataset nor a grading config`]})]})]})]}),`\n`,_jsxs(RequestExample,{children:[_jsx(CodeBlock,{filename:`cURL`,numberOfLines:`4`,language:`shellscript`,children:_jsx(_components.pre,{className:`shiki shiki-themes github-light-default dark-plus`,style:{backgroundColor:`#ffffff`,\"--shiki-dark-bg\":`#0B0C0E`,color:`#1f2328`,\"--shiki-dark\":`#D4D4D4`},language:`shellscript`,children:_jsxs(_components.code,{language:`shellscript`,numberOfLines:`4`,children:[_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#DCDCAA`},children:`curl`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:` -X`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` POST`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` http://localhost:4700/api/v1/ingest/traces/mJ3vQ8pTr2LqYw6bZk9Xd/evaluate`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D7BA7D`},children:` \\\\`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:` -H`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"x-api-key: agtx_local_0f3c9a17d2b84e6a5c01b9f4e7d8a2c6431b5f97a0e2d4c8\"`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D7BA7D`},children:` \\\\`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:` -H`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"Content-Type: application/json\"`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D7BA7D`},children:` \\\\`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:` -d`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` '{ \"datasetId\": \"dS4tG7hNb2VxZ8kQ5wMyA\" }'`})]}),`\n`]})})}),_jsx(CodeBlock,{filename:`Python SDK`,numberOfLines:`6`,language:`python`,children:_jsx(_components.pre,{className:`shiki shiki-themes github-light-default dark-plus`,style:{backgroundColor:`#ffffff`,\"--shiki-dark-bg\":`#0B0C0E`,color:`#1f2328`,\"--shiki-dark\":`#D4D4D4`},language:`python`,children:_jsxs(_components.code,{language:`python`,numberOfLines:`6`,children:[_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`result `}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` client.tracer.evaluate_trace(`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#9CDCFE`},children:` trace_id`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"mJ3vQ8pTr2LqYw6bZk9Xd\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#9CDCFE`},children:` dataset_id`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D4D4D4`},children:`=`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"dS4tG7hNb2VxZ8kQ5wMyA\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`)`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#DCDCAA`},children:`print`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`(result[`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"rating\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`])`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#DCDCAA`},children:`print`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`(result[`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"justification\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`])`})]}),`\n`]})})})]}),`\n`,_jsxs(ResponseExample,{children:[_jsx(CodeBlock,{filename:`200 OK`,numberOfLines:`7`,language:`json`,children:_jsx(_components.pre,{className:`shiki shiki-themes github-light-default dark-plus`,style:{backgroundColor:`#ffffff`,\"--shiki-dark-bg\":`#0B0C0E`,color:`#1f2328`,\"--shiki-dark\":`#D4D4D4`},language:`json`,children:_jsxs(_components.code,{language:`json`,numberOfLines:`7`,children:[_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`{`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"run_id\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"rK7dP2qWx9TzB4mV6nJcE\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"trace_id\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"mJ3vQ8pTr2LqYw6bZk9Xd\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"rating\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`8`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"justification\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"The agent correctly described the password reset flow and provided accurate step-by-step instructions.\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"status\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"completed\"`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`}`})}),`\n`]})})}),_jsx(CodeBlock,{filename:`404 Not found`,numberOfLines:`3`,language:`json`,children:_jsx(_components.pre,{className:`shiki shiki-themes github-light-default dark-plus`,style:{backgroundColor:`#ffffff`,\"--shiki-dark-bg\":`#0B0C0E`,color:`#1f2328`,\"--shiki-dark\":`#D4D4D4`},language:`json`,children:_jsxs(_components.code,{language:`json`,numberOfLines:`3`,children:[_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`{`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"error\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"Trace not found\"`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`}`})}),`\n`]})})})]})]})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent};function _missingMdxReference(id,component){throw new Error(`Expected `+(component?`component`:`object`)+\" `\"+id+\"` to be defined: you likely forgot to import, pass, or provide it.\")}","frontmatter":{},"scope":{"config":{},"pageMetadata":{"title":"Evaluate Trace","api":"POST /api/v1/ingest/traces/{traceId}/evaluate","description":"Score a recorded trace against a dataset or grading config without re-running the agent","href":"/api-reference/tracing/evaluate-trace"}}}},"mdxExtracts":{"tableOfContents":[{"title":"Authentication","slug":"authentication","depth":2,"children":[]},{"title":"Path Parameters","slug":"path-parameters","depth":2,"children":[]},{"title":"Body","slug":"body","depth":2,"children":[]},{"title":"Response","slug":"response","depth":2,"children":[]},{"title":"Errors","slug":"errors","depth":2,"children":[]}],"codeExamples":{"request":{"type":"RequestExample","children":[{"filename":"cURL","html":"\u003cpre class=\"shiki shiki-themes github-light-default dark-plus\" style=\"background-color:#ffffff;--shiki-dark-bg:#0B0C0E;color:#1f2328;--shiki-dark:#D4D4D4\" language=\"shellscript\">\u003ccode language=\"shellscript\" numberOfLines=\"4\">\u003cspan class=\"line\">\u003cspan style=\"color:#953800;--shiki-dark:#DCDCAA\">curl\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\"> -X\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> POST\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> http://localhost:4700/api/v1/ingest/traces/mJ3vQ8pTr2LqYw6bZk9Xd/evaluate\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D7BA7D\"> \\\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\"> -H\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> \"x-api-key: agtx_local_0f3c9a17d2b84e6a5c01b9f4e7d8a2c6431b5f97a0e2d4c8\"\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D7BA7D\"> \\\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\"> -H\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> \"Content-Type: application/json\"\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D7BA7D\"> \\\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\"> -d\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> '{ \"datasetId\": \"dS4tG7hNb2VxZ8kQ5wMyA\" }'\u003c/span>\u003c/span>\n\u003c/code>\u003c/pre>"},{"filename":"Python SDK","html":"\u003cpre class=\"shiki shiki-themes github-light-default dark-plus\" style=\"background-color:#ffffff;--shiki-dark-bg:#0B0C0E;color:#1f2328;--shiki-dark:#D4D4D4\" language=\"python\">\u003ccode language=\"python\" numberOfLines=\"6\">\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">result \u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D4D4D4\">=\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> client.tracer.evaluate_trace(\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#953800;--shiki-dark:#9CDCFE\"> trace_id\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D4D4D4\">=\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"mJ3vQ8pTr2LqYw6bZk9Xd\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#953800;--shiki-dark:#9CDCFE\"> dataset_id\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D4D4D4\">=\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"dS4tG7hNb2VxZ8kQ5wMyA\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">)\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0550AE;--shiki-dark:#DCDCAA\">print\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">(result[\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"rating\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">])\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0550AE;--shiki-dark:#DCDCAA\">print\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">(result[\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"justification\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">])\u003c/span>\u003c/span>\n\u003c/code>\u003c/pre>"}],"attributes":[]},"response":{"type":"ResponseExample","children":[{"filename":"200 OK","html":"\u003cpre class=\"shiki shiki-themes github-light-default dark-plus\" style=\"background-color:#ffffff;--shiki-dark-bg:#0B0C0E;color:#1f2328;--shiki-dark:#D4D4D4\" language=\"json\">\u003ccode language=\"json\" numberOfLines=\"7\">\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">{\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"run_id\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"rK7dP2qWx9TzB4mV6nJcE\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"trace_id\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"mJ3vQ8pTr2LqYw6bZk9Xd\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"rating\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">8\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"justification\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"The agent correctly described the password reset flow and provided accurate step-by-step instructions.\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"status\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"completed\"\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">}\u003c/span>\u003c/span>\n\u003c/code>\u003c/pre>"},{"filename":"404 Not found","html":"\u003cpre class=\"shiki shiki-themes github-light-default dark-plus\" style=\"background-color:#ffffff;--shiki-dark-bg:#0B0C0E;color:#1f2328;--shiki-dark:#D4D4D4\" language=\"json\">\u003ccode language=\"json\" numberOfLines=\"3\">\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">{\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"error\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"Trace not found\"\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">}\u003c/span>\u003c/span>\n\u003c/code>\u003c/pre>"}],"attributes":[]}},"endpoint":{"title":"Evaluate Trace","path":"/api/v1/ingest/traces/{traceId}/evaluate","servers":[{"url":"http://localhost:4700"}],"method":"post","request":{"security":[{"title":"API Key Auth","parameters":{"header":{"x-api-key":{"type":"apiKey"}},"query":{},"cookie":{}}}],"parameters":{"query":{},"header":{"x-api-key":{"schema":[{"type":"string","description":"Project API key.","required":true}]}},"cookie":{},"path":{"traceId":{"schema":[{"type":"string","description":"ID of the trace to evaluate, returned by `POST /ingest/traces` .","required":true}]}}},"body":{"application/json":{"schemaArray":[{"type":"object","properties":{"datasetId":[{"type":"string","description":"ID of the dataset or standalone evaluation-settings config to score against. Datasets grade with their own criteria; a grading config brings its own judge prompt/model.","required":true}]}}],"examples":{"example":{"value":{"datasetId":"\u003cstring>"}}}}}},"response":{"200":{"application/json":{"schemaArray":[{"type":"object","properties":{"run_id":[{"type":"string","description":"ID of the created one-result evaluation run."}],"trace_id":[{"type":"string","description":"Echoed back for confirmation."}],"rating":[{"type":"object","properties":{},"description":"Score from 0 (poor) to 10 (excellent). `null` when the judge could not score (for example, no judge LLM key is configured) - the run’s result row records the reason."}],"justification":[{"type":"object","properties":{},"description":"LLM-generated explanation of the score."}],"status":[{"type":"string","description":"Always `\"completed\"` on success."}]}}],"examples":{"example":{"value":{"run_id":"\u003cstring>","trace_id":"\u003cstring>","rating":{},"justification":{},"status":"\u003cstring>"}}}}}},"deprecated":false}},"jsLinks":[],"subdomain":"agentx-ffe8d995","siteName":"AgentX","title":"Evaluate Trace - AgentX","navMaps":{"firstHrefInVersion":{},"firstHrefInLanguage":{}},"lastModified":"2026-09-12T02:33:39.189Z","originalFileLocation":"api-reference/tracing/evaluate-trace.mdx"},"headHtml":"\u003cscript data-mint-head>(function(){var d=document.documentElement,p=null;if(!p){try{p=localStorage.getItem(\"isDarkMode\")}catch(e){}if(p==='true')p='dark';else if(p==='false')p='light';if(p!=='light'\u0026\u0026p!=='dark'\u0026\u0026p!=='system')p=\"system\"}var r=p==='system'?(matchMedia(\"(prefers-color-scheme: dark)\").matches?'dark':'light'):p;d.classList.remove(r==='dark'?'light':'dark');d.classList.add(r);d.setAttribute(\"data-theme-preference\",p)})();\u003c/script>\u003cmeta data-mint-head name=\"description\" content=\"Score a recorded trace against a dataset or grading config without re-running the agent\">\u003cmeta data-mint-head name=\"application-name\" content=\"AgentX\">\u003cmeta data-mint-head name=\"generator\" content=\"Mintlify\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/agentx-ffe8d995/sticQuUfAA1h_xwo/_generated/favicon/android-chrome-192x192.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"apple-touch-icon\" type=\"image/png\" sizes=\"180x180\" href=\"/mintlify-assets/_mintlify/favicons/agentx-ffe8d995/sticQuUfAA1h_xwo/_generated/favicon/apple-touch-icon.png\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/agentx-ffe8d995/sticQuUfAA1h_xwo/_generated/favicon/favicon-16x16.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/agentx-ffe8d995/sticQuUfAA1h_xwo/_generated/favicon/favicon-32x32.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/agentx-ffe8d995/sticQuUfAA1h_xwo/_generated/favicon/favicon.ico\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/agentx-ffe8d995/sticQuUfAA1h_xwo/_generated/favicon-dark/android-chrome-192x192.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/agentx-ffe8d995/sticQuUfAA1h_xwo/_generated/favicon-dark/favicon-16x16.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/agentx-ffe8d995/sticQuUfAA1h_xwo/_generated/favicon-dark/favicon-32x32.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/agentx-ffe8d995/sticQuUfAA1h_xwo/_generated/favicon-dark/favicon.ico\" media=\"(prefers-color-scheme: dark)\">\u003cmeta data-mint-head property=\"og:title\" content=\"Evaluate Trace - AgentX\">\u003cmeta data-mint-head property=\"og:description\" content=\"Score a recorded trace against a dataset or grading config without re-running the agent\">\u003cmeta data-mint-head property=\"og:site_name\" content=\"AgentX\">\u003cmeta data-mint-head property=\"og:url\" content=\"https://developers.agentx.so/api-reference/tracing/evaluate-trace\">\u003cmeta data-mint-head property=\"og:type\" content=\"website\">\u003cmeta data-mint-head property=\"og:image\" content=\"https://agentx-ffe8d995.mintlify.site/_mintlify/api/og/v2?division=Tracing\u0026amp;title=Evaluate+Trace\u0026amp;description=Score+a+recorded+trace+against+a+dataset+or+grading+config+without+re-running+the+agent\u0026amp;theme=2ebdc38e645cd0f197f78a50\u0026amp;signature=b76d84d3e18b266972ffceca5a37e37d857089d8b8a6366b6da7a3506801d010\">\u003cmeta data-mint-head property=\"og:image:width\" content=\"1200\">\u003cmeta data-mint-head property=\"og:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"twitter:card\" content=\"summary_large_image\">\u003cmeta data-mint-head name=\"twitter:title\" content=\"Evaluate Trace - AgentX\">\u003cmeta data-mint-head name=\"twitter:description\" content=\"Score a recorded trace against a dataset or grading config without re-running the agent\">\u003cmeta data-mint-head name=\"twitter:image\" content=\"https://agentx-ffe8d995.mintlify.site/_mintlify/api/og/v2?division=Tracing\u0026amp;title=Evaluate+Trace\u0026amp;description=Score+a+recorded+trace+against+a+dataset+or+grading+config+without+re-running+the+agent\u0026amp;theme=2ebdc38e645cd0f197f78a50\u0026amp;signature=b76d84d3e18b266972ffceca5a37e37d857089d8b8a6366b6da7a3506801d010\">\u003cmeta data-mint-head name=\"twitter:image:width\" content=\"1200\">\u003cmeta data-mint-head name=\"twitter:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"msapplication-config\" content=\"/mintlify-assets/_mintlify/favicons/agentx-ffe8d995/sticQuUfAA1h_xwo/_generated/favicon/browserconfig.xml\">\u003cmeta data-mint-head name=\"apple-mobile-web-app-title\" content=\"AgentX\">\u003cmeta data-mint-head name=\"msapplication-TileColor\" content=\"#2A5699\">\u003clink data-mint-head rel=\"canonical\" href=\"https://developers.agentx.so/api-reference/tracing/evaluate-trace\">\u003clink data-mint-head rel=\"alternate\" type=\"application/xml\" href=\"/sitemap.xml\">\u003clink data-mint-head rel=\"alternate\" type=\"text/markdown\" href=\"/api-reference/tracing/evaluate-trace.md\">\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https://developers.agentx.so/#organization\",\"name\":\"AgentX\",\"url\":\"https://developers.agentx.so\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https://mintcdn.com/agentx-ffe8d995/ZTzZ3HDQJ-RJxymw/logo/light.png?fit=max\u0026auto=format\u0026n=ZTzZ3HDQJ-RJxymw\u0026q=85\u0026s=c1e30c949dc1cc2aaa3a137c1ee5c77f\"}},{\"@type\":\"WebSite\",\"@id\":\"https://developers.agentx.so#website\",\"name\":\"AgentX\",\"url\":\"https://developers.agentx.so\",\"publisher\":{\"@id\":\"https://developers.agentx.so/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https://developers.agentx.so/api-reference/tracing/evaluate-trace#webpage\",\"url\":\"https://developers.agentx.so/api-reference/tracing/evaluate-trace\",\"name\":\"Evaluate Trace\",\"description\":\"Score a recorded trace against a dataset or grading config without re-running the agent\",\"dateModified\":\"2026-09-12T02:33:39.189Z\",\"isPartOf\":{\"@id\":\"https://developers.agentx.so#website\"},\"breadcrumb\":{\"@id\":\"https://developers.agentx.so/api-reference/tracing/evaluate-trace#breadcrumb\"}},{\"@type\":\"BreadcrumbList\",\"@id\":\"https://developers.agentx.so/api-reference/tracing/evaluate-trace#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Tracing\",\"item\":\"https://developers.agentx.so/api-reference/tracing/submit-trace\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Evaluate Trace\",\"item\":\"https://developers.agentx.so/api-reference/tracing/evaluate-trace\"}]},{\"@type\":[\"TechArticle\",\"APIReference\"],\"@id\":\"https://developers.agentx.so/api-reference/tracing/evaluate-trace#apireference\",\"headline\":\"Evaluate Trace\",\"name\":\"Evaluate Trace\",\"description\":\"Score a recorded trace against a dataset or grading config without re-running the agent\",\"url\":\"https://developers.agentx.so/api-reference/tracing/evaluate-trace\",\"mainEntityOfPage\":{\"@id\":\"https://developers.agentx.so/api-reference/tracing/evaluate-trace#webpage\"},\"dateModified\":\"2026-09-12T02:33:39.189Z\",\"publisher\":{\"@id\":\"https://developers.agentx.so/#organization\"},\"isPartOf\":{\"@id\":\"https://developers.agentx.so#website\"}}]}\u003c/script>\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@type\":\"WebSite\",\"name\":\"AgentX\",\"publisher\":{\"@type\":\"Organization\",\"name\":\"AgentX\"},\"provider\":{\"@type\":\"Organization\",\"name\":\"Mintlify\",\"url\":\"https://mintlify.com\"}}\u003c/script>","agentPointerHref":"/api-reference/tracing/evaluate-trace.md","siteName":"AgentX","nav":{"global":null,"tabs":[{"tab":"Documentation","pages":[{"title":"Documentation","href":"/introduction"}]},{"tab":"Trace","pages":[{"title":"Trace","href":"/sdk/tracing"}]},{"tab":"Scorers \u0026 Monitoring","pages":[{"title":"Scorers \u0026 Monitoring","href":"/monitor/scorers"}]},{"tab":"Offline Evaluation","pages":[{"title":"Offline Evaluation","href":"/sdk/evaluations/overview"}]},{"tab":"Improve","pages":[{"title":"Improve","href":"/improve/tool-schemas"}]},{"tab":"CI/CD","pages":[{"title":"CI/CD","href":"/integrations/self-host-ci"}]},{"tab":"API Reference","groups":[{"group":"Tracing","pages":[{"title":"Submit Trace","api":"POST /api/v1/ingest/traces","href":"/api-reference/tracing/submit-trace"},{"title":"List Traces","api":"GET /api/v1/ingest/traces","description":"Cursor-paginated list of ingested traces with database-side search and filters","href":"/api-reference/tracing/list-traces"},{"title":"Evaluate Trace","api":"POST /api/v1/ingest/traces/{traceId}/evaluate","href":"/api-reference/tracing/evaluate-trace"}]},{"group":"Custom Evaluations","pages":[{"title":"Custom Evaluations Overview","description":"Run evaluations programmatically against any external agent and score with the LLM judge","href":"/api-reference/custom-eval/overview"},{"title":"Create Dataset","api":"POST /api/v1/custom-agent-evaluations/datasets","href":"/api-reference/custom-eval/create-dataset"},{"title":"List Datasets","api":"GET /api/v1/custom-agent-evaluations/datasets","href":"/api-reference/custom-eval/list-datasets"},{"title":"Get Dataset","api":"GET /api/v1/custom-agent-evaluations/datasets/{datasetId}","href":"/api-reference/custom-eval/get-dataset"},{"title":"Create Run","api":"POST /api/v1/custom-agent-evaluations/runs","href":"/api-reference/custom-eval/create-run"},{"title":"Submit Results","api":"POST /api/v1/custom-agent-evaluations/runs/{runId}/results","href":"/api-reference/custom-eval/submit-results"},{"title":"Get Missing Results","api":"GET /api/v1/custom-agent-evaluations/runs/{runId}/missing-results","href":"/api-reference/custom-eval/missing-results"},{"title":"Finalize Run","api":"POST /api/v1/custom-agent-evaluations/runs/{runId}/finalize","href":"/api-reference/custom-eval/finalize-run"},{"title":"Analyze Run","api":"POST /api/v1/custom-agent-evaluations/runs/{runId}/analyze","href":"/api-reference/custom-eval/analyze-run"},{"title":"Get Report","api":"GET /api/v1/custom-agent-evaluations/runs/{runId}/report","href":"/api-reference/custom-eval/get-report"},{"title":"Get Run","api":"GET /api/v1/custom-agent-evaluations/runs/{runId}","href":"/api-reference/custom-eval/get-run"},{"title":"List Runs","api":"GET /api/v1/custom-agent-evaluations/runs","href":"/api-reference/custom-eval/list-runs"},{"title":"List Models","api":"GET /api/v1/agent-monitoring/portability/models","href":"/api-reference/custom-eval/list-models"}]},{"group":"CI Gate","pages":[{"title":"CI/CD Overview","href":"/api-reference/ci-cd/overview"},{"title":"Create CI Run","api":"POST /api/v1/custom-agent-evaluations/runs","href":"/api-reference/ci-cd/create-run"},{"title":"Get Test Cases","api":"GET /api/v1/custom-agent-evaluations/datasets/{datasetId}","href":"/api-reference/ci-cd/get-test-cases"},{"title":"Submit Result","api":"POST /api/v1/custom-agent-evaluations/runs/{runId}/results","href":"/api-reference/ci-cd/submit-result"},{"title":"Finalize CI Run","api":"POST /api/v1/custom-agent-evaluations/runs/{runId}/finalize","href":"/api-reference/ci-cd/finalize-run"},{"title":"Get CI Gate","api":"GET /api/v1/custom-agent-evaluations/runs/{runId}/gate","href":"/api-reference/ci-cd/get-gate"}]},{"group":"Agent Registry","pages":[{"title":"List Agents","api":"GET /api/v1/agents","href":"/api-reference/tracked-agents/list"},{"title":"Register Agent","api":"POST /api/v1/agents","href":"/api-reference/tracked-agents/add"},{"title":"Get Agent","api":"GET /api/v1/agents/{id}","href":"/api-reference/tracked-agents/get"}]}]}]},"basePath":"","title":"Evaluate Trace - AgentX","deploymentId":"dpl_DyXGnKeCjZyA3sUdfMJ7FjkdBefg","buildId":"dpl_DyXGnKeCjZyA3sUdfMJ7FjkdBefg","dynamics":["c2aa737661","2b790eda92","b0f84f53ff"],"chunks":["OpenApiReferenceProvider-CiUHMMOm.js","snippetPresets-BgfXU7Bw.js","utils-DWvOwgy_.js","style-to-object-BY3JEAdk.js","utils-BN7RXSMJ.js","v4-DIgz8zy6.js","addUniqueKeysToSchema-CFw8bq89.js","conditional-requirements-CFM0id0Q.js","cloneDeep-CAwdfOU2.js","_Uint8Array-BJr8e-ZL.js","isObject-FP1Yky1u.js","ApiExamples-XX0UgMZK.js","usePlaygroundInputsStore-DXDFSa1V.js","shallow-CdX5aREi.js","isEqual-CoOaxexF.js","CodeSnippets-Cg2wpzWm.js","CodeSnippet-D_HwgQO_.js","getApiPlaygroundDisplay-CmCoerhe.js","Page-CVJ-f_k1.js","DynamicMarkdown-CQM9Bhbv.js","SectionHeading-DpbrP8nQ.js","icon-BPCgijHy.js","MethodPill-GQ8DuY0c.js","getPastedJson-Cb5mT31m.js","Check2Icon-a7bUI6e8.js","axios-CsQoIw0U.js"]}