Update Evaluation Set Item

If you need to change the expected output for a given evaluation set item, you can use this endpoint to update the item. This can be useful if you need to correct an error in the expected output or if the output of the extractor, classifier, or splitter has changed.

Authentication

AuthorizationBearer

Bearer authentication of the form Bearer <token>, where token is your auth token.

Path parameters

evaluationSetIdstringRequired

The ID of the evaluation set.

Example: "ev_2LcgeY_mp2T5yPaEuq5Lw"

itemIdstringRequired

The ID of the evaluation set item.

Example: "evi_kR9mNP12Qw4yTv8BdR3H"

Request

This endpoint expects an object.

expectedOutputobjectRequired

The expected output of the extractor, classifier, or splitter when run against the file. This must conform to the output schema of the entity associated with the evaluation set.

Response

Successfully updated evaluation set item

objectenum

The type of object. In this case, it will always be "evaluation_set_item".

Allowed values:

idstring

The ID of the evaluation set item.

Example: "evi_kR9mNP12Qw4yTv8BdR3H"

evaluationSetIdstring

The ID of the evaluation set that this item belongs to.

Example: "ev_2LcgeY_mp2T5yPaEuq5Lw"

fileobject

A summary of the file associated with the evaluation set item.

expectedOutputobject

The expected output that will be used to evaluate the performance of the extractor, classifier, or splitter associated with the evaluation set. This must conform to the output schema of the entity associated with the evaluation set.

1	import { ExtendClient, ExtendEnvironment } from "extend-ai";
2
3	async function main() {
4	const client = new ExtendClient({
5	environment: ExtendEnvironment.Production,
6	token: "YOUR_TOKEN_HERE",
7	});
8	await client.evaluationSetItems.update("evaluation_set_id_here", "evaluation_set_item_id_here", {
9	expectedOutput: {
10	value: {
11	"vendor_name": "Acme Corp",
12	"invoice_number": "INV-001",
13	"total_amount": 1750,
14	},
15	},
16	});
17	}
18	main();

1	{
2	"object": "evaluation_set_item",
3	"id": "evi_kR9mNP12Qw4yTv8BdR3H",
4	"evaluationSetId": "ev_2LcgeY_mp2T5yPaEuq5Lw",
5	"file": {
6	"object": "file",
7	"id": "file_xK9mLPqRtN3vS8wF5hB2cQ",
8	"name": "Invoices.pdf",
9	"type": "PDF",
10	"parentFileId": "file_Zk9mNP12Qw4yTv8BdR3H",
11	"metadata": {
12	"pageCount": 30,
13	"parentSplit": {
14	"id": "string",
15	"type": "Invoice",
16	"identifier": "other_2_9",
17	"startPage": 1,
18	"endPage": 10
19	}
20	},
21	"createdAt": "2024-03-21T16:45:00Z",
22	"updatedAt": "2024-03-21T16:45:00Z"
23	},
24	"expectedOutput": {
25	"value": {}
26	}
27	}

Update Evaluation Set Item

Authentication

Path parameters

Headers

Request

Response

Errors